00000001:02000400:2.0F:1789479753.005478:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789479776.589040:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789479779.021635:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 475 MB/s 00000001:01000000:2.0:1789479779.274089:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 776 MB/s 00000001:01000000:2.0:1789479779.523517:0:3216:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2447 MB/s 00000020:02000000:2.0:1789479780.949991:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g9b6d8f0 00000400:02000000:3.0:1789479782.591419:0:3282:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.154@tcp [8/256/0/180] 00008000:02000000:2.0:1789479786.813726:0:3432:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1789479849.591227:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789479861.193136:0:5810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789479861.193143:0:5810:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789479861.193338:0:5810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008b4c27d9 00000080:02000400:2.0:1789479861.193349:0:5810:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789479861.198676:0:5810:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789479861.198691:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789479861.198737:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b379d200) 00000020:00000080:2.0:1789479861.198759:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789479861.213821:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789479861.214264:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789479861.238853:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789479861.238900:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789479861.238921:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789479861.238984:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789479861.239016:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789479861.240090:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789479861.240100:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789479861.240118:0:5810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd14a 00000020:01000004:3.0:1789479861.240128:0:5810:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789479861.240133:0:5810:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789479861.240140:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008b4c27d9 from MGS 00000020:01000004:3.0:1789479861.240145:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789479861.240167:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006372bf68) 00000020:00000080:3.0:1789479861.240182:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789479861.240257:0:5810:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b4c27d9 from MGS, refs=2 00080000:01000000:3.0:1789479861.240263:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789479861.240268:0:5810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd158 00000100:00100000:3.0:1789479861.240416:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789479861.240547:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789479861.240630:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789479861.241100:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789479861.241107:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789479861.241882:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479861.242245:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789479861.242251:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789479861.243148:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789479861.243155:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789479861.243532:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789479861.243539:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789479861.244161:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.244165:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.244166:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.244469:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.244471:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.244473:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479861.245318:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789479861.248086:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789479861.496425:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3003 MB/s 00000001:01000000:2.0:1789479861.747677:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2589 MB/s 00000001:01000000:0.0:1789479861.999217:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 390 MB/s 00000001:01000000:2.0:1789479862.248435:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 500 MB/s 00080000:10000000:2.0:1789479862.259750:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789479862.287132:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789479862.287152:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789479862.287156:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789479862.296413:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789479862.296514:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789479862.296596:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789479862.296883:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789479862.296913:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789479862.297242:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479862.297460:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789479862.297467:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1789479862.299597:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479862.303105:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789479862.303128:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789479862.309838:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789479862.309856:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789479862.310888:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789479862.310912:0:5810:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1789479862.310926:0:5810:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789479862.311030:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:3.0:1789479862.311044:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (00000000e3c2e9ca) 00000020:00000080:3.0:1789479862.311064:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789479862.311146:0:5810:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fae3d78f@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789479862.311362:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1789479862.311369:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789479862.319764:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789479862.319840:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid e677fecc-98d9-457e-99be-c06439303d19) 00000020:00000080:3.0:1789479862.319868:0:5810:0:(genops.c:1384:class_connect()) connect: client e677fecc-98d9-457e-99be-c06439303d19, cookie 0xbb972366037fd166 00000100:00080000:3.0:1789479862.319884:0:5810:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789479862.319898:0:5810:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import 00000000fae3d78f using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789479862.319979:0:5810:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005e6206ac x1876405551890560/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789479862.320008:0:5810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e677fecc-98d9-457e-99be-c06439303d19->MGS 00000020:01000004:3.0:1789479862.320030:0:5810:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789479862.320035:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789479862.320049:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a63bfed) 00000020:00000080:3.0:1789479862.320062:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1789479862.322588:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789479862.322747:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e6206ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e677fecc-98d9-457e-99be-c06439303d19:3297:1876405551890560:0@lo:250: 00000100:00100000:1.0:1789479862.322854:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479862.335591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551890560 00000100:00100000:2.0:1789479862.339973:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551890560 00000100:00100000:2.0:1789479862.340042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479862.340050:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036d58997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876405551890560:12345-0@lo:250: 00010000:00080000:2.0:1789479862.340082:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e677fecc-98d9-457e-99be-c06439303d19@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1789479862.340131:0:5823:0:(genops.c:1384:class_connect()) connect: client e677fecc-98d9-457e-99be-c06439303d19, cookie 0xbb972366037fd174 00000100:00080000:2.0:1789479862.340328:0:5823:0:(import.c:65:import_set_state_nolock()) 000000009609f426 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479862.342432:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036d58997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+5:3297:x1876405551890560:12345-0@lo:250: Request processed in 2376us (19573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.342449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479862.342730:0:3297:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789479862.342742:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1789479862.342751:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789479862.342757:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789479862.342760:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000fae3d78f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789479862.342763:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789479862.342781:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789479862.342786:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e6206ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e677fecc-98d9-457e-99be-c06439303d19:3297:1876405551890560:0@lo:250: 00000100:00100000:3.0:1789479862.351165:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479862.351691:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789479862.351699:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789479862.358599:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479862.358632:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789479862.359086:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789479862.359092:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789479862.359903:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479862.360114:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789479862.360119:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789479862.361117:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789479862.361132:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789479862.422506:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479862.422774:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789479862.422783:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789479862.425791:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789479862.425806:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789479862.427114:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789479862.427388:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789479862.427394:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789479862.428709:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789479862.428720:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789479862.436870:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789479862.437083:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789479862.437090:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789479862.445702:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789479862.448264:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789479862.451015:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479862.451398:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789479862.451406:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789479862.453526:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789479862.453538:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789479862.506038:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479862.506412:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789479862.506418:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789479862.508274:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479862.508354:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789479862.509052:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789479862.509059:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789479862.510721:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789479862.510760:0:5810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789479862.510770:0:5810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789479862.510931:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789479862.510980:0:5810:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789479862.510985:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789479862.510987:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789479862.510988:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479862.510989:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479862.510991:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479862.510992:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479862.510993:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789479862.510994:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789479862.510996:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479862.510997:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479862.511001:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479862.511002:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479862.511005:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789479862.511007:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789479862.511008:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789479862.511009:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479862.511010:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479862.511011:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479862.511012:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479862.511013:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789479862.511014:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789479862.511014:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479862.511015:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479862.511016:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479862.511017:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479862.511047:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789479862.511063:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890688:0@lo:253: 00000100:00100000:3.0:1789479862.511270:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.511474:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065c1fc1a going to sleep for 11 seconds 00000100:00100000:0.0:1789479862.511528:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551890688 00000100:00100000:0.0:1789479862.511536:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551890688 00000100:00100000:0.0:1789479862.511691:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479862.511699:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b42a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+5:5810:x1876405551890688:12345-0@lo:253: 20000000:01000000:0.0:1789479862.511747:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789479862.511750:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789479862.512094:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789479862.512157:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789479862.512534:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479862.513535:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789479862.513830:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789479862.513836:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789479862.513841:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789479862.513845:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789479862.513860:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789479862.514151:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479862.514373:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789479862.514386:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789479862.514432:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789479862.514480:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789479862.514517:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789479862.514845:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789479862.514862:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789479862.514916:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789479862.514924:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789479862.514975:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789479862.514983:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789479862.515018:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789479862.515071:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789479862.515105:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789479862.515110:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789479862.515122:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479862.516469:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789479862.516492:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789479862.516551:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789479862.516586:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789479862.517577:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789479862.517599:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789479862.517894:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789479862.517904:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789479862.518967:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789479862.519081:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789479862.519121:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789479862.519139:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789479862.520308:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789479862.520326:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789479862.520362:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789479862.520399:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789479862.520592:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789479862.520859:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789479862.520868:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789479862.521332:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789479862.521709:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789479862.521737:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:2.0:1789479862.521739:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789479862.521795:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789479862.521805:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789479862.521837:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789479862.521845:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1789479862.521909:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789479862.521921:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789479862.521967:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789479862.522004:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789479862.522070:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789479862.522074:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789479862.522080:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789479862.522088:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789479862.522718:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789479862.523064:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789479862.532030:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789479862.532087:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789479862.532173:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789479862.532195:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789479862.532198:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789479862.532202:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789479862.532220:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789479862.532223:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789479862.532258:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789479862.532260:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789479862.533107:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789479862.533505:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789479862.533714:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789479862.533778:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789479862.533792:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789479862.533794:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789479862.537370:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789479862.538011:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789479862.538066:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789479862.538103:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789479862.538117:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789479862.538119:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789479862.538134:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479862.538155:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538172:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538182:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538188:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538194:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538200:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538206:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe2fd6cb already unused, calling callback (00000000b974ffd5) 00010000:00010000:0.0:1789479862.538209:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538216:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538228:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538235:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.538240:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd17b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789479862.538259:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789479862.871110:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b42a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+5:5810:x1876405551890688:12345-0@lo:253: Request processed in 359402us (359831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479862.871133:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479862.871223:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890688:0@lo:253: 10000000:01000000:3.0:1789479862.871240:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789479862.871257:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789479862.871259:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789479862.871261:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479862.871262:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789479862.871263:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479862.871265:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479862.871266:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789479862.871267:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789479862.871268:0:5810:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789479862.871270:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479862.871271:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789479862.871305:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008b4c27d9 from lustre-MDT0000 10000000:01000000:3.0:1789479862.871329:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789479862.871332:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789479862.871336:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d229c723380 10000000:01000000:3.0:1789479862.871341:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479862.871350:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d229c723380 from 1 10000000:01000000:3.0:1789479862.871353:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789479862.871392:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.871403:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.871412:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479862.871431:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890816:0@lo:101: 00000100:00100000:3.0:1789479862.871467:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.871570:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:0.0:1789479862.871716:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551890816 00000100:00100000:0.0:1789479862.871723:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551890816 00000100:00100000:0.0:1789479862.871803:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479862.871811:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e04f57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+5:5810:x1876405551890816:12345-0@lo:101: 00010000:00010000:0.0:1789479862.871822:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479862.871835:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd182 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.871857:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd182 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.871867:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe2fd6cb/0xbb972366037fd189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd182 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479862.871875:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe2fd6cb, rc 0) 00000100:00100000:0.0:1789479862.871961:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e04f57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+6:5810:x1876405551890816:12345-0@lo:101: Request processed in 152us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479862.871967:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479862.872038:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890816:0@lo:101: 00010000:00010000:3.0:1789479862.872051:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.872070:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479862.872116:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890944:0@lo:501: 00000100:00100000:3.0:1789479862.872140:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.872203:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:0.0:1789479862.872240:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551890944 00000100:00100000:0.0:1789479862.872244:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551890944 00000100:00100000:0.0:1789479862.872379:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789479862.872386:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e9bf540 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+6:5810:x1876405551890944:12345-0@lo:501: 00000100:00100000:0.0:1789479862.872666:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e9bf540 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+6:5810:x1876405551890944:12345-0@lo:501: Request processed in 280us (524us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479862.872674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479862.872818:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551890944:0@lo:501: 10000000:01000000:3.0:1789479862.872847:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789479862.872867:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.872876:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000403912b5/0xbb972366037fd182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479862.872883:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d22aea50800 10000000:01000000:3.0:1789479862.872887:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789479862.872891:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d22aea50800 10000000:01000000:3.0:1789479862.872893:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789479862.872896:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d22aea50800 from 1 10000000:01000000:3.0:1789479862.872898:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789479862.872916:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.872922:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.872929:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479862.872962:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891072:0@lo:101: 00000100:00100000:3.0:1789479862.872987:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.873007:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:2.0:1789479862.873069:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891072 00000100:00100000:2.0:1789479862.873074:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891072 00000100:00100000:2.0:1789479862.873095:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479862.873100:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a7683e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+6:5810:x1876405551891072:12345-0@lo:101: 00010000:00010000:2.0:1789479862.873109:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479862.873121:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb5918f2/0xbb972366037fd197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd190 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873138:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb5918f2/0xbb972366037fd197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd190 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873146:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb5918f2/0xbb972366037fd197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd190 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873153:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb5918f2, rc 0) 00000100:00100000:2.0:1789479862.873192:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a7683e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+7:5810:x1876405551891072:12345-0@lo:101: Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.873198:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479862.873270:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891072:0@lo:101: 00010000:00010000:3.0:1789479862.873307:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.873316:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479862.873327:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789479862.873332:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.873339:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000ff62fc7b/0xbb972366037fd190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479862.873344:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789479862.873347:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479862.873351:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d22aea50800 10000000:01000000:3.0:1789479862.873353:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789479862.873356:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789479862.873357:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789479862.873369:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.873375:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.873391:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479862.873403:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891200:0@lo:101: 00000100:00100000:3.0:1789479862.873427:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.873442:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:2.0:1789479862.873497:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891200 00000100:00100000:2.0:1789479862.873501:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891200 00000100:00100000:2.0:1789479862.873532:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479862.873538:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a632d63b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+7:5810:x1876405551891200:12345-0@lo:101: 00010000:00010000:2.0:1789479862.873544:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479862.873551:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063578e19/0xbb972366037fd1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd19e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873564:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063578e19/0xbb972366037fd1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd19e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873577:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063578e19/0xbb972366037fd1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd19e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479862.873584:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063578e19, rc 0) 00000100:00100000:2.0:1789479862.873617:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a632d63b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+8:5810:x1876405551891200:12345-0@lo:101: Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.873622:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479862.873751:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891200:0@lo:101: 00010000:00010000:3.0:1789479862.873760:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479862.873767:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479862.873804:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891328:0@lo:501: 00000100:00100000:3.0:1789479862.873830:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.873851:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:2.0:1789479862.873897:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891328 00000100:00100000:2.0:1789479862.873902:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891328 00000100:00100000:2.0:1789479862.873918:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479862.873923:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc042e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+8:5810:x1876405551891328:12345-0@lo:501: 00000100:00100000:2.0:1789479862.874143:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc042e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:5810:x1876405551891328:12345-0@lo:501: Request processed in 220us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.874150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479862.874224:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891328:0@lo:501: 00000100:00100000:3.0:1789479862.874250:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891456:0@lo:503: 00000100:00100000:3.0:1789479862.874324:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.874341:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094bec08e going to sleep for 11 seconds 00000100:00100000:2.0:1789479862.874393:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891456 00000100:00100000:2.0:1789479862.874398:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891456 00000100:00100000:2.0:1789479862.874415:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479862.874419:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007701c892 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:5810:x1876405551891456:12345-0@lo:503: 00000100:00100000:2.0:1789479862.874657:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007701c892 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:5810:x1876405551891456:12345-0@lo:503: Request processed in 237us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.874664:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789479862.874747:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891456:0@lo:503: 00000100:00100000:3.0:1789479862.875189:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5853:1876405551891584:0@lo:502: 00000100:00100000:3.0:1789479862.875227:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479862.875251:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3536d3e going to sleep for 11 seconds 00000100:00100000:2.0:1789479862.875304:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891584 00000100:00100000:2.0:1789479862.875309:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891584 00000100:00100000:2.0:1789479862.875339:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479862.875345:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8763b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:5853:x1876405551891584:12345-0@lo:502: 00000100:00100000:2.0:1789479862.875674:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8763b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:5853:x1876405551891584:12345-0@lo:502: Request processed in 329us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479862.875691:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789479862.875868:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5853:1876405551891584:0@lo:502: 00000020:01000000:2.0:1789479862.875989:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479862.876004:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479862.876006:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789479862.876013:0:5853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789479862.876015:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479862.876029:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000f98f7b0) 00000020:00000080:2.0:1789479862.876049:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789479862.876055:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789479862.876141:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789479862.876149:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd1b3 00000020:00000080:2.0:1789479862.876431:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789479862.876436:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479862.876439:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479862.876441:0:5853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789479862.876443:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479862.876446:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479862.876447:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789479862.876450:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479862.876458:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000083aa691f) 00000020:00000080:2.0:1789479862.876468:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789479862.876472:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789479862.876473:0:5853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789479862.876476:0:5853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789479862.876482:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789479862.876609:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b4c27d9 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789479862.876625:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b62665c9) 00000020:00000080:2.0:1789479862.876633:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789479862.876690:0:5853:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789479862.876695:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fd1c8 00000020:00000080:2.0:1789479862.876804:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789479862.876810:0:5853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789479862.876820:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb972366037fd1cf 00080000:01000000:2.0:1789479862.876826:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789479862.876829:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd1d6 00080000:10000000:2.0:1789479862.877253:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789479862.877762:0:5853:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789479862.882266:0:5853:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789479862.985640:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789479862.992163:0:5853:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789479862.994213:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789479862.994540:0:5853:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789479863.093524:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000052e8ea35) 00000020:00000080:1.0:1789479863.093550:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789479863.093630:0:5853:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789479863.093638:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd1e4 00000020:00000080:1.0:1789479863.096446:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789479863.102584:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.221002:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789479863.294087:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789479863.323682:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789479863.365707:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.431695:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.477500:0:5853:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789479863.507405:0:5853:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb972366037fd1eb 00000020:00000080:1.0:1789479863.507811:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789479863.507825:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479863.507831:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479863.507833:0:5853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789479863.507836:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479863.507842:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479863.507843:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789479863.507847:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789479863.507884:0:5853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789479863.507902:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479863.507905:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479863.507906:0:5853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789479863.507909:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479863.507911:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479863.507913:0:5853:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479863.507915:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479863.507917:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789479863.507982:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075b429f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5853:1876405551891712:0@lo:502: 00000100:00100000:1.0:1789479863.508070:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.508135:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3c55b16 going to sleep for 11 seconds 00000100:00100000:2.0:1789479863.508305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891712 00000100:00100000:2.0:1789479863.508313:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891712 00000100:00100000:2.0:1789479863.508356:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479863.508365:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007de9ed5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+9:5853:x1876405551891712:12345-0@lo:502: 00000100:00100000:2.0:1789479863.508970:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007de9ed5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+9:5853:x1876405551891712:12345-0@lo:502: Request processed in 605us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.508979:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479863.509121:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075b429f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5853:1876405551891712:0@lo:502: 00000020:01000000:1.0:1789479863.509154:0:5853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479863.509161:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479863.509164:0:5853:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479863.509175:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789479863.509464:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789479863.509489:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789479863.509621:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479863.509634:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000e1c42f75/0xbb972366037fd19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479863.509710:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d22aea50800 from 1 10000000:01000000:3.0:1789479863.509714:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789479863.509752:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.509760:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.509771:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479863.509791:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891840:0@lo:101: 00000100:00100000:3.0:1789479863.509835:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.509872:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000971b1786 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.509933:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891840 00000100:00100000:1.0:1789479863.509940:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891840 00000100:00100000:1.0:1789479863.509977:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789479863.509984:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001bc296df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+9:5810:x1876405551891840:12345-0@lo:101: 00010000:00010000:1.0:1789479863.509994:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479863.510007:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd1f2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.510028:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.510037:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.510046:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0bb253f, rc 0) 00000100:00100000:1.0:1789479863.510083:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001bc296df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+10:5810:x1876405551891840:12345-0@lo:101: Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.510089:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789479863.510159:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891840:0@lo:101: 00010000:00010000:3.0:1789479863.510172:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.510180:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479863.510777:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891968:0@lo:256: 00000100:00100000:3.0:1789479863.510821:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.510845:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000971b1786 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.511226:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551891968 00000100:00100000:1.0:1789479863.511233:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551891968 00000100:00100000:1.0:1789479863.511270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789479863.511276:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000155f7e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+10:5810:x1876405551891968:12345-0@lo:256: 20000000:01000000:1.0:1789479863.511318:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789479863.511324:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789479863.511401:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000155f7e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+10:5810:x1876405551891968:12345-0@lo:256: Request processed in 125us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.511407:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479863.511634:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551891968:0@lo:256: 10000000:01000000:3.0:1789479863.512257:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789479863.512488:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.512626:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479863.512634:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22aea50800 from 1 10000000:01000000:3.0:1789479863.512637:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479863.512672:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.512679:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.512689:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479863.512708:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892096:0@lo:101: 00000100:00100000:3.0:1789479863.512763:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.512802:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000971b1786 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.512856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892096 00000100:00100000:1.0:1789479863.512868:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892096 00000100:00100000:1.0:1789479863.512914:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789479863.512920:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000226092f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+10:5810:x1876405551892096:12345-0@lo:101: 00010000:00010000:1.0:1789479863.512941:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479863.512955:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd200 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.512976:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.512986:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.512994:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3a7070d, rc 0) 00000100:00100000:1.0:1789479863.513036:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000226092f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892096:12345-0@lo:101: Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.513042:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479863.513161:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892096:0@lo:101: 00010000:00010000:3.0:1789479863.513172:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.513179:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479863.513226:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892224:0@lo:501: 00000100:00100000:3.0:1789479863.513250:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.513275:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000971b1786 going to sleep for 11 seconds 00000100:00100000:2.0:1789479863.513367:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892224 00000100:00100000:2.0:1789479863.513372:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892224 00000100:00100000:2.0:1789479863.513398:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789479863.513403:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000793f68a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892224:12345-0@lo:501: 00000100:00100000:2.0:1789479863.514071:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000793f68a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892224:12345-0@lo:501: Request processed in 666us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.514080:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479863.514273:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892224:0@lo:501: 00000100:00100000:3.0:1789479863.514342:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892352:0@lo:503: 00000100:00100000:3.0:1789479863.514385:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.514409:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000971b1786 going to sleep for 11 seconds 00000100:00100000:2.0:1789479863.514599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892352 00000100:00100000:2.0:1789479863.514604:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892352 00000100:00100000:2.0:1789479863.514639:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789479863.514645:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bccfe041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892352:12345-0@lo:503: 00000040:00080000:2.0:1789479863.514684:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789479863.514719:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bccfe041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892352:12345-0@lo:503: Request processed in 75us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.514726:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479863.514837:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892352:0@lo:503: 00000040:00080000:3.0:1789479863.516080:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789479863.516378:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789479863.516407:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479863.516430:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479863.516442:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479863.516488:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789479863.516491:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d22aea50800 10000000:01000000:0.0:1789479863.516494:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d22aea50800 10000000:01000000:0.0:1789479863.516498:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789479863.516504:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22aea50800 from 1 10000000:01000000:0.0:1789479863.516507:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479863.516567:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479863.516575:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479863.516584:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479863.516605:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c8b1a67 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892480:0@lo:101: 00000100:00100000:0.0:1789479863.516665:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479863.516705:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b0ee078 going to sleep for 11 seconds 00000100:00100000:3.0:1789479863.521869:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892480 00000100:00100000:3.0:1789479863.521888:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892480 00000100:00100000:3.0:1789479863.521991:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789479863.522002:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a858bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551892480:12345-0@lo:101: 00010000:00010000:3.0:1789479863.522020:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479863.522041:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000885fa6e7/0xbb972366037fd215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd20e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.522070:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000885fa6e7/0xbb972366037fd215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.522081:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000885fa6e7/0xbb972366037fd215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479863.522089:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000885fa6e7, rc 0) 00000100:00100000:3.0:1789479863.522238:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a858bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551892480:12345-0@lo:101: Request processed in 238us (5573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479863.522246:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479863.528996:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c8b1a67 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892480:0@lo:101: 00010000:00010000:0.0:1789479863.529035:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479863.529048:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479863.529260:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075b429f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892608:0@lo:501: 00000100:00100000:1.0:1789479863.529411:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.529466:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edfc64e0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479863.529552:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892608 00000100:00100000:2.0:1789479863.529560:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892608 00000100:00100000:2.0:1789479863.529611:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789479863.529621:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058e27500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551892608:12345-0@lo:501: 00000100:00100000:2.0:1789479863.529943:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058e27500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551892608:12345-0@lo:501: Request processed in 323us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.529950:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789479863.530224:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075b429f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892608:0@lo:501: 00000100:00100000:3.0:1789479863.530264:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892736:0@lo:503: 00000100:00100000:3.0:1789479863.530341:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479863.530371:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d2a6e73 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.530433:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892736 00000100:00100000:1.0:1789479863.530439:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892736 00000100:00100000:1.0:1789479863.530479:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479863.530485:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034c1ee55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551892736:12345-0@lo:503: 00000100:00100000:1.0:1789479863.531101:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034c1ee55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551892736:12345-0@lo:503: Request processed in 614us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.531110:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789479863.531203:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551892736:0@lo:503: 00000100:00100000:1.0:1789479863.531780:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007939fe26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5858:1876405551892864:0@lo:502: 00000100:00100000:1.0:1789479863.531839:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.531878:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000003abc73e9 going to sleep for 11 seconds 00000100:00100000:2.0:1789479863.532122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892864 00000100:00100000:2.0:1789479863.532128:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892864 00000100:00100000:2.0:1789479863.532170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479863.532178:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6c036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5858:x1876405551892864:12345-0@lo:502: 00000100:00100000:2.0:1789479863.532476:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6c036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5858:x1876405551892864:12345-0@lo:502: Request processed in 298us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.532482:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479863.532689:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007939fe26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5858:1876405551892864:0@lo:502: 00000020:01000004:0.0:1789479863.532778:0:5858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789479863.532806:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d814802d) 00000020:00000080:0.0:1789479863.532831:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789479863.532974:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008b4c27d9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789479863.532979:0:5858:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008b4c27d9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789479863.532981:0:5858:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008b4c27d9 4 00010000:00080000:0.0:1789479863.533010:0:5858:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b610a7ed@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789479863.535278:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789479863.536064:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789479863.536106:0:5858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789479863.536120:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb972366037fd223 00000100:00080000:0.0:1789479863.536131:0:5858:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789479863.536144:0:5858:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b610a7ed using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789479863.536183:0:5858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c8b1a67 x1876405551892992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789479863.536210:0:5858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789479863.536670:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c8b1a67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551892992:0@lo:38: 00000100:00100000:1.0:1789479863.536758:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479863.538613:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551892992 00000100:00100000:0.0:1789479863.538628:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551892992 00000100:00100000:0.0:1789479863.538679:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479863.538686:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8b210e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405551892992:12345-0@lo:38: 00000100:00100000:0.0:1789479863.538799:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8b210e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405551892992:12345-0@lo:38: Request processed in 112us (2042us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789479863.538806:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479863.541353:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000311784ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5858:1876405551893120:0@lo:502: 00000100:00100000:0.0:1789479863.541446:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.542046:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789479863.542058:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000b610a7ed lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789479863.542064:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789479863.542068:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c8b1a67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551892992:0@lo:38: 00000100:00100000:2.0:1789479863.542398:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893120 00000100:00100000:2.0:1789479863.542406:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893120 00000100:00100000:2.0:1789479863.542465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479863.542474:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070afb6cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5858:x1876405551893120:12345-0@lo:502: 00000100:00100000:2.0:1789479863.545235:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070afb6cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5858:x1876405551893120:12345-0@lo:502: Request processed in 2752us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479863.545251:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789479863.547011:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d95a168 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.547052:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000311784ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:5858:1876405551893120:0@lo:502: 00000040:00080000:1.0:1789479863.547095:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789479863.547247:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789479863.547267:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479863.547301:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479863.547312:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000088967e95/0xbb972366037fd20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789479863.547364:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789479863.547367:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479863.547368:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479863.547369:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479863.547370:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479863.547372:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479863.547373:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479863.547375:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479863.547376:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479863.547377:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479863.547378:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479863.547380:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479863.547383:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789479863.547385:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789479863.547386:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479863.547388:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479863.547389:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479863.547390:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479863.547391:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479863.547391:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479863.547393:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479863.547394:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479863.547395:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479863.547396:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479863.547397:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479863.547423:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789479863.547440:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551893248:0@lo:253: 00000100:00100000:0.0:1789479863.547590:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479863.547628:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7404f64 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.547838:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893248 00000100:00100000:1.0:1789479863.547847:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893248 00000100:00100000:1.0:1789479863.547904:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479863.547911:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002116218b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5810:x1876405551893248:12345-0@lo:253: 20000000:01000000:1.0:1789479863.547952:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789479863.547966:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789479863.609602:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789479863.609617:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789479863.609638:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789479863.609642:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789479863.609660:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.609680:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.609689:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.609755:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.609770:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 12 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479863.609783:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aba85108 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551893376:0@lo:104: 00000100:00100000:1.0:1789479863.610091:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.610145:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068091316 going to sleep for 11 seconds 00000100:00100000:1.0:1789479863.610179:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893376 00000100:00100000:1.0:1789479863.610186:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893376 00000100:00100000:1.0:1789479863.610231:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479863.610240:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f86df6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551893376:12345-0@lo:104: 00010000:00010000:1.0:1789479863.610251:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610331:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789479863.610336:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f86df6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551893376:12345-0@lo:104: Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.610343:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789479863.610365:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789479863.610371:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610378:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e1a7365 already unused, calling callback (00000000bf0dddc0) 10000000:00010000:1.0:1789479863.610381:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610401:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479863.610407:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479863.610412:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479863.610443:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610449:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479863.610467:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610473:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000005e1a7365/0xbb972366037fd1f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610491:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479863.610492:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479863.610494:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479863.610626:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098fc16f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551893504:0@lo:103: 00000100:00100000:1.0:1789479863.610655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479863.610717:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893504 00000100:00100000:1.0:1789479863.610722:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893504 00010000:00010000:1.0:1789479863.610746:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 13 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479863.610770:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479863.610776:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a9abad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3299:x1876405551893504:12345-0@lo:103: 00010000:00010000:1.0:1789479863.610792:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479863.610797:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 13 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610806:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 13 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610821:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.610829:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789479863.610843:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001202241s 00010000:00010000:1.0:1789479863.610847:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611110:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611116:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611122:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611126:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d39fb389 already unused, calling callback (00000000b974ffd5) 00010000:00010000:1.0:1789479863.611130:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611136:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611151:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611160:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479863.611193:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a9abad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3299:x1876405551893504:12345-0@lo:103: Request processed in 419us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.611199:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479863.611237:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098fc16f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551893504:0@lo:103: 00010000:00010000:1.0:1789479863.611260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0bb253f/0xbb972366037fd1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd1f2 expref: 12 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479863.611271:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aba85108 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551893376:0@lo:104: 00010000:00010000:1.0:1789479863.611315:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611323:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611329:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479863.611334:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d39fb389/0xbb972366037fd22a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479863.630072:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002116218b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:5810:x1876405551893248:12345-0@lo:253: Request processed in 82077us (82397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479863.630090:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789479863.630210:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:5810:1876405551893248:0@lo:253: 10000000:01000000:0.0:1789479863.630226:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789479863.630229:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479863.630231:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479863.630233:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479863.630234:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479863.630235:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479863.630236:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479863.630238:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479863.630239:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479863.630241:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479863.630242:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479863.630243:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479863.630245:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479863.630259:0:5810:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789479863.644722:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789479863.647751:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789479863.657220:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.659099:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789479863.659467:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.661348:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789479863.665725:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.666160:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789479863.666418:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.666602:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789479863.666815:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789479863.667721:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789479863.785727:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789479863.824831:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789479863.825371:0:5863:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789479863.825376:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789479863.825459:0:5864:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789479863.838259:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789479863.838652:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789479863.839079:0:5810:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789479863.839087:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789479863.839229:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789479863.841412:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789479863.843107:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789479863.843192:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789479863.843777:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789479863.844017:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789479863.854343:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789479863.854549:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789479863.854674:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789479863.854839:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789479863.855019:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789479863.855193:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789479863.855368:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789479863.855525:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789479863.855651:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789479863.859462:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789479863.859722:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789479863.860043:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789479863.860187:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789479863.865122:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789479863.865391:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789479863.865982:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789479863.866332:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789479863.866529:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789479863.866681:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789479863.877330:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789479863.879434:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789479863.879953:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789479863.883185:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789479863.883456:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789479863.885421:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789479863.885641:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789479863.885771:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789479863.890540:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789479863.890876:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789479863.891080:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789479863.891228:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789479863.891433:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789479863.891670:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789479863.911642:0:5864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789479864.076195:0:5810:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789479864.076236:0:5810:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa28701c43988 00100000:10000000:1.0:1789479864.076244:0:5810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789479864.079397:0:5810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789479864.079417:0:5810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789479864.079432:0:5810:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789479864.079462:0:5810:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789479864.135595:0:5864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789479864.135684:0:5864:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789479864.135690:0:5864:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789479864.349458:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479865.370484:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479866.397970:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479867.419432:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479868.442574:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789479868.762420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789479868.762432:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789479868.762435:0:36:0:(import.c:65:import_set_state_nolock()) 00000000b610a7ed lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789479868.762466:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b610a7ed using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789479868.762498:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ac939191 x1876405551893760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789479868.762721:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac939191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551893760:0@lo:38: 00000100:00100000:1.0:1789479868.762796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479868.766388:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551893632:0@lo:400: 00000100:00100000:2.0:1789479868.766469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479868.766757:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893632 00000100:00100000:1.0:1789479868.766767:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893632 00000100:00100000:1.0:1789479868.766814:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479868.766833:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bce8bb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:3300:x1876405551893632:12345-0@lo:400: 00000100:00100000:1.0:1789479868.766891:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bce8bb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:3300:x1876405551893632:12345-0@lo:400: Request processed in 69us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479868.766898:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479868.766952:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f02154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551893632:0@lo:400: 00000100:00100000:3.0:1789479868.771360:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893760 00000100:00100000:3.0:1789479868.771380:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893760 00000100:00100000:3.0:1789479868.771440:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479868.771447:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aba85108 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405551893760:12345-0@lo:38: 00010000:00080000:3.0:1789479868.771476:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1789479868.771519:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb972366037fd231 00000004:00100000:3.0:1789479868.771578:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789479868.771728:0:5832:0:(import.c:65:import_set_state_nolock()) 000000002a9da169 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479868.771816:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aba85108 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876405551893760:12345-0@lo:38: Request processed in 368us (9020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479868.771841:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789479868.776258:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ac939191 x1876405551893760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789479868.776309:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789479868.776320:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789479868.776326:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789479868.776330:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000b610a7ed lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479868.776337:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac939191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551893760:0@lo:38: 00000001:02000400:3.0:1789479869.142314:0:6107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789479869.476099:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479870.492171:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789479871.322613:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789479871.322623:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d22aea50800 from 3 10000000:01000000:1.0:1789479871.322628:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479871.322680:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479871.322692:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479871.322715:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479871.322740:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098fc16f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551893888:0@lo:101: 00000100:00100000:1.0:1789479871.322829:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479871.322889:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe339bcf going to sleep for 11 seconds 00000100:00100000:2.0:1789479871.323004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551893888 00000100:00100000:2.0:1789479871.323012:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551893888 00000100:00100000:2.0:1789479871.323065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789479871.323074:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e8cb17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:5827:x1876405551893888:12345-0@lo:101: 00010000:00010000:2.0:1789479871.323089:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479871.323103:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c9aee52/0xbb972366037fd23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd238 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479871.323126:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c9aee52/0xbb972366037fd23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd238 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479871.323135:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c9aee52/0xbb972366037fd23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd238 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479871.323143:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c9aee52, rc 0) 00000100:00100000:2.0:1789479871.323194:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e8cb17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551893888:12345-0@lo:101: Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479871.323200:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789479871.323240:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098fc16f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551893888:0@lo:101: 00010000:00010000:0.0:1789479871.323257:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479871.323267:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479871.323365:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894016:0@lo:256: 00000100:00100000:0.0:1789479871.323401:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479871.323429:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000592c6ae8 going to sleep for 11 seconds 00000100:00100000:2.0:1789479871.323551:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894016 00000100:00100000:2.0:1789479871.323557:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894016 00000100:00100000:2.0:1789479871.323590:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789479871.323596:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036553ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894016:12345-0@lo:256: 20000000:01000000:2.0:1789479871.323611:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789479871.323626:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789479871.323630:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789479871.323723:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036553ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894016:12345-0@lo:256: Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479871.323730:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789479871.323882:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894016:0@lo:256: 10000000:01000000:0.0:1789479871.323933:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789479871.323939:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479871.323948:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000d39fb389/0xbb972366037fd238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479871.516716:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479872.538476:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479873.563459:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479873.885703:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479873.885741:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab67ecb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551894144:0@lo:400: 00000100:00100000:1.0:1789479873.885817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479873.885875:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e814ccc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551894272:0@lo:400: 00000100:00100000:1.0:1789479873.885902:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479873.885958:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894144 00000100:00100000:1.0:1789479873.885966:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894144 00000100:00100000:1.0:1789479873.886006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479873.886013:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065f711ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:3300:x1876405551894144:12345-0@lo:400: 00000100:00100000:1.0:1789479873.886058:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065f711ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:3300:x1876405551894144:12345-0@lo:400: Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479873.886064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479873.886098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894272 00000100:00100000:1.0:1789479873.886102:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894272 00000100:00100000:1.0:1789479873.886127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479873.886133:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2163434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551894272:12345-0@lo:400: 00000100:00100000:1.0:1789479873.886165:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2163434 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551894272:12345-0@lo:400: Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479873.886171:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479873.886200:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab67ecb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551894144:0@lo:400: 00010000:00080000:1.0:1789479873.886225:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e814ccc x1876405551894272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479873.886241:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e814ccc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551894272:0@lo:400: 00010000:00010000:0.0:1789479874.586536:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789479874.786815:0:6308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf5b4fc90 20000000:00000080:2.0:1789479874.786837:0:6308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22a4a9ec00 uarg=0000000000000000 20000000:01000000:2.0:1789479874.786873:0:6308:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789479874.786880:0:6308:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789479874.786885:0:6308:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789479874.787091:0:6308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789479874.787105:0:6308:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789479874.795045:0:6308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479874.795367:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789479874.795423:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789479874.795470:0:6308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789479874.795487:0:6308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789479874.795507:0:6308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.795527:0:6308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.795534:0:6308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.796188:0:6308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.796205:0:6308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479874.796220:0:6308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6308:1876405551894400:0@lo:104: 00000100:00100000:2.0:1789479874.796336:0:6308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479874.796408:0:6308:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2fb50f0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.796418:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894400 00000100:00100000:1.0:1789479874.796427:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894400 00000100:00100000:1.0:1789479874.796476:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479874.796485:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a47e233c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:6308:x1876405551894400:12345-0@lo:104: 00010000:00010000:1.0:1789479874.796503:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479874.796571:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789479874.796576:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a47e233c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:6308:x1876405551894400:12345-0@lo:104: Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.796591:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789479874.796626:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479874.796632:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796640:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c50e5a14 already unused, calling callback (00000000bf0dddc0) 10000000:00010000:0.0:1789479874.796643:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796651:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479874.796657:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479874.796663:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789479874.796702:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796719:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479874.796755:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796762:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 00000000c50e5a14/0xbb972366037fd200 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd207 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796782:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479874.796784:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479874.796786:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479874.796793:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479874.796804:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551894528:0@lo:103: 00000100:00100000:0.0:1789479874.796835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479874.796870:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894528 00000100:00100000:0.0:1789479874.796874:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894528 00010000:00010000:0.0:1789479874.796892:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479874.796916:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479874.796922:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074fbe07e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+12:3298:x1876405551894528:12345-0@lo:103: 00010000:00010000:0.0:1789479874.796933:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479874.796937:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796947:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796965:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.796973:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797000:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797007:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797013:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797018:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797024:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e43f8201 already unused, calling callback (00000000b974ffd5) 00010000:00010000:0.0:1789479874.797027:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797033:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797040:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.797050:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479874.797078:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074fbe07e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+12:3298:x1876405551894528:12345-0@lo:103: Request processed in 157us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479874.797085:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479874.797124:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb48c055 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551894528:0@lo:103: 00010000:00010000:2.0:1789479874.797194:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3a7070d/0xbb972366037fd207 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd200 expref: 11 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479874.797206:0:6308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6308:1876405551894400:0@lo:104: 00010000:00010000:2.0:1789479874.797219:0:6308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.797227:0:6308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.797232:0:6308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.797238:0:6308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e43f8201/0xbb972366037fd246 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479875.612527:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479876.634960:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479877.663842:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789479878.560092:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789479878.560102:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22aea50800 from 1 10000000:01000000:2.0:1789479878.560187:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789479878.560322:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000e43f8201/0xbb972366037fd24d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479878.560343:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000e43f8201/0xbb972366037fd24d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479878.560355:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000e43f8201/0xbb972366037fd24d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479878.560380:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894656:0@lo:101: 00000100:00100000:2.0:1789479878.560467:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479878.560529:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d95a168 going to sleep for 11 seconds 00000100:00100000:3.0:1789479878.561245:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894656 00000100:00100000:3.0:1789479878.561259:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894656 00000100:00100000:3.0:1789479878.561338:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789479878.561348:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4e06532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:5827:x1876405551894656:12345-0@lo:101: 00010000:00010000:3.0:1789479878.561367:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479878.561386:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003536a7a4/0xbb972366037fd254 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd24d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479878.561419:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003536a7a4/0xbb972366037fd254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd24d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479878.561433:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003536a7a4/0xbb972366037fd254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd24d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479878.561452:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003536a7a4, rc 0) 00000100:00100000:3.0:1789479878.561518:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4e06532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894656:12345-0@lo:101: Request processed in 171us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479878.561524:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789479878.562353:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894656:0@lo:101: 00010000:00010000:2.0:1789479878.562378:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000e43f8201/0xbb972366037fd24d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479878.562391:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000e43f8201/0xbb972366037fd24d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479878.562466:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894784:0@lo:501: 00000100:00100000:2.0:1789479878.562515:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479878.562555:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d95a168 going to sleep for 11 seconds 00000100:00100000:2.0:1789479878.562575:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894784 00000100:00100000:2.0:1789479878.562581:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894784 00000100:00100000:2.0:1789479878.562616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479878.562624:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9c8fc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894784:12345-0@lo:501: 00000100:00100000:2.0:1789479878.562922:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9c8fc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894784:12345-0@lo:501: Request processed in 299us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479878.562929:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479878.562975:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894784:0@lo:501: 00000100:00100000:2.0:1789479878.563003:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894912:0@lo:503: 00000100:00100000:2.0:1789479878.563041:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479878.563059:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d95a168 going to sleep for 11 seconds 00000100:00100000:2.0:1789479878.563072:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551894912 00000100:00100000:2.0:1789479878.563075:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551894912 00000100:00100000:2.0:1789479878.563097:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479878.563102:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067b5f59b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894912:12345-0@lo:503: 00000100:00100000:2.0:1789479878.566870:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067b5f59b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551894912:12345-0@lo:503: Request processed in 3759us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479878.566888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789479878.567919:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a709e144 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551894912:0@lo:503: 00000100:00100000:3.0:1789479878.568517:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e14d7bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6544:1876405551895040:0@lo:502: 00000100:00100000:3.0:1789479878.568604:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479878.568656:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015a85f72 going to sleep for 11 seconds 00000100:00100000:3.0:1789479878.573575:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895040 00000100:00100000:3.0:1789479878.573593:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895040 00000100:00100000:3.0:1789479878.573670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479878.573681:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009e438ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:6544:x1876405551895040:12345-0@lo:502: 00000100:00100000:3.0:1789479878.573963:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009e438ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:6544:x1876405551895040:12345-0@lo:502: Request processed in 283us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479878.573971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479878.574045:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e14d7bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6544:1876405551895040:0@lo:502: 00000020:01000000:3.0:1789479878.574087:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479878.574097:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479878.574099:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789479878.574108:0:6544:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22aea50800 00000020:00000080:3.0:1789479878.574110:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789479878.574162:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6544:1876405551895168:0@lo:502: 00000100:00100000:3.0:1789479878.574208:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479878.574325:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479878.577004:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895168 00000100:00100000:2.0:1789479878.577022:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895168 00000100:00100000:2.0:1789479878.577079:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789479878.577090:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:6544:x1876405551895168:12345-0@lo:502: 00000100:00100000:2.0:1789479878.584541:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:6544:x1876405551895168:12345-0@lo:502: Request processed in 7442us (10322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479878.584556:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789479878.587626:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6544:1876405551895168:0@lo:502: 00000020:01000000:0.0:1789479878.587698:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479878.587709:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479878.587712:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789479878.587718:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789479878.589295:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789479878.589332:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479878.589343:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479878.589358:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479878.684609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479879.004176:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479879.004216:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551895296:0@lo:400: 00000100:00100000:2.0:1789479879.004337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479879.004452:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895296 00000100:00100000:3.0:1789479879.004474:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895296 00000100:00100000:3.0:1789479879.004540:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479879.004550:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551895296:12345-0@lo:400: 00000100:00100000:3.0:1789479879.004613:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551895296:12345-0@lo:400: Request processed in 65us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479879.004620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789479879.004770:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22a452fb80 x1876405551895296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479879.004784:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551895296:0@lo:400: 00010000:00010000:2.0:1789479879.710483:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479880.730663:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479881.757778:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789479882.087541:0:6683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789479882.087545:0:6683:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789479882.088066:0:6683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d22a4535800 00000020:01000004:3.0:1789479882.088083:0:6683:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789479882.088094:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789479882.088108:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d229c724d40) 00000020:00000080:3.0:1789479882.088133:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789479882.149740:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789479882.150127:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789479882.194082:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789479882.214998:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789479882.215045:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789479882.215106:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789479882.215137:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789479882.215544:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789479882.215557:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789479882.215600:0:6683:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fd262 00000020:01000004:0.0:1789479882.215609:0:6683:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789479882.217128:0:6683:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789479882.217134:0:6683:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789479882.217143:0:6683:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789479882.217150:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789479882.217167:0:6683:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d22b99c3380) 00000020:00000080:0.0:1789479882.217184:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789479882.219221:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789479882.219426:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789479882.219433:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789479882.221459:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479882.221478:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789479882.222198:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789479882.222206:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789479882.223333:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479882.223494:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789479882.223499:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789479882.230490:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789479882.230505:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789479882.257596:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479882.259379:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789479882.259389:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789479882.261594:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789479882.261670:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789479882.266308:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789479882.266377:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789479882.273247:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789479882.273903:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789479882.273911:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789479882.286815:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789479882.286863:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789479882.400127:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479882.402972:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789479882.402981:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789479882.408923:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789479882.408941:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789479882.410232:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789479882.410261:0:6683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789479882.410268:0:6683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789479882.469108:0:6683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789479882.469337:0:6683:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789479882.469342:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789479882.469343:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789479882.469345:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479882.469346:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479882.469347:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479882.469349:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479882.469350:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479882.469351:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479882.469353:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479882.469355:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479882.469356:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789479882.469360:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789479882.469362:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789479882.469364:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789479882.469365:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479882.469366:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479882.469367:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479882.469368:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479882.469369:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479882.469371:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479882.469372:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479882.469373:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479882.469374:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789479882.469400:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789479882.469418:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551895424:0@lo:253: 00000100:00100000:0.0:1789479882.469490:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479882.469545:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.469940:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895424 00000100:00100000:3.0:1789479882.469949:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895424 00000100:00100000:3.0:1789479882.470020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789479882.470030:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551895424:12345-0@lo:253: 20000000:01000000:3.0:1789479882.470076:0:5823:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789479882.470080:0:5823:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789479882.470085:0:5823:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789479882.470088:0:5823:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789479882.474647:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789479882.474964:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789479882.474982:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789479882.475030:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789479882.475039:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789479882.475071:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789479882.475123:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789479882.475614:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789479882.475638:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:3.0:1789479882.475640:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:3.0:1789479882.475676:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789479882.475685:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789479882.475746:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789479882.475758:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:3.0:1789479882.475798:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789479882.475807:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789479882.475841:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789479882.475881:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789479882.476596:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789479882.476614:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:3.0:1789479882.476616:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:3.0:1789479882.476666:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789479882.476675:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789479882.476710:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789479882.476719:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:3.0:1789479882.476781:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789479882.476790:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789479882.476823:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789479882.476860:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789479882.476877:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789479882.476880:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789479882.476884:0:5823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789479882.476897:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789479882.476900:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789479882.476932:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789479882.476935:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479882.478686:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479882.478772:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479882.478831:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789479882.479250:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789479882.479347:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789479882.479435:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789479882.479452:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789479882.479454:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789479882.481626:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789479882.482068:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789479882.482123:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789479882.482227:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789479882.482241:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789479882.482244:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479882.483190:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479882.483254:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479882.483332:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789479882.483921:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789479882.483983:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789479882.484041:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789479882.484060:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789479882.484063:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789479882.484073:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479882.484096:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484116:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd182 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484125:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd19e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484133:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484155:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484197:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484211:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.484225:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4994000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895552:0@lo:104: 00000100:00100000:0.0:1789479882.484331:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479882.484396:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484406:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 12 pid: 5823 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.484421:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895680:0@lo:104: 00000100:00100000:0.0:1789479882.484443:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479882.484533:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.484542:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 12 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.484550:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895808:0@lo:104: 00000100:00100000:0.0:1789479882.484586:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479882.485574:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789479882.485874:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895552 00000100:00100000:2.0:1789479882.485883:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895552 00000100:00100000:3.0:1789479882.487337:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895680 00000100:00100000:3.0:1789479882.487350:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895680 00000100:00100000:3.0:1789479882.487366:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895808 00000100:00100000:3.0:1789479882.487370:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895808 00000100:00100000:3.0:1789479882.487388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479882.487400:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+5:5823:x1876405551895552:12345-0@lo:104: 00010000:00010000:3.0:1789479882.487419:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487634:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479882.487641:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+5:5823:x1876405551895552:12345-0@lo:104: Request processed in 243us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.487648:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479882.487683:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479882.487689:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+4:5823:x1876405551895680:12345-0@lo:104: 00010000:00010000:3.0:1789479882.487697:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487737:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789479882.487742:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+4:5823:x1876405551895680:12345-0@lo:104: Request processed in 54us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.487748:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479882.487760:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479882.487765:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5823:x1876405551895808:12345-0@lo:104: 00010000:00010000:3.0:1789479882.487772:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487800:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789479882.487805:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5823:x1876405551895808:12345-0@lo:104: Request processed in 41us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.487809:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789479882.487828:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789479882.487835:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487844:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030c00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479882.487848:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487857:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479882.487878:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.487884:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479882.487928:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487934:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479882.487960:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487969:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280030c00/0xbb972366037fd20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd215 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487984:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479882.487987:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.487993:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7138800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479882.487997:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488005:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479882.488012:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.488017:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479882.488038:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488044:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479882.488060:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488067:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7138800/0xbb972366037fd19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd1a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488078:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479882.488081:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488086:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7139400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479882.488090:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488097:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479882.488102:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.488108:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479882.488120:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.488126:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479882.488132:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.488415:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479882.488450:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479882.488468:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551895936:0@lo:103: 00000100:00100000:2.0:1789479882.488517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.488610:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551895936 00000100:00100000:2.0:1789479882.488615:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551895936 00010000:00010000:2.0:1789479882.488639:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.488664:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479882.488671:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3300:x1876405551895936:12345-0@lo:103: 00010000:00010000:2.0:1789479882.488682:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479882.488688:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.488698:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.488717:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479882.488745:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3300:x1876405551895936:12345-0@lo:103: Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.488751:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479882.488784:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551895936:0@lo:103: 00000100:00100000:2.0:1789479882.488809:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551896064:0@lo:103: 00000100:00100000:2.0:1789479882.488830:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.488868:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479882.488874:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551896192:0@lo:103: 00000100:00100000:2.0:1789479882.488895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.488917:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896064 00000100:00100000:2.0:1789479882.488920:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896064 00010000:00010000:2.0:1789479882.488934:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 13 pid: 5823 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.488948:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896192 00000100:00100000:2.0:1789479882.488951:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896192 00010000:00010000:2.0:1789479882.488961:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 14 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.488972:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479882.488977:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+14:3298:x1876405551896064:12345-0@lo:103: 00010000:00010000:2.0:1789479882.488984:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479882.488988:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 14 pid: 5823 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.488997:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 14 pid: 5823 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489007:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479882.489031:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+14:3298:x1876405551896064:12345-0@lo:103: Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.489037:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479882.489049:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479882.489055:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3298:x1876405551896192:12345-0@lo:103: 00010000:00010000:2.0:1789479882.489062:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479882.489066:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489080:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489093:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489103:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489120:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489127:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489133:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.489316:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd189 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.489335:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479882.489337:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479882.489338:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479882.489404:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489412:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789479882.489417:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489426:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489435:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.489458:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479882.489486:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3298:x1876405551896192:12345-0@lo:103: Request processed in 431us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.489492:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479882.489520:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551896192:0@lo:103: 00000100:00100000:2.0:1789479882.489527:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551896064:0@lo:103: 00010000:00010000:0.0:1789479882.489999:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22b7139200/0xbb972366037fd215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd20e expref: 12 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.490010:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4994000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895552:0@lo:104: 00010000:00010000:0.0:1789479882.490038:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2400/0xbb972366037fd1a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd19e expref: 11 pid: 5823 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.490049:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895680:0@lo:104: 00010000:00010000:0.0:1789479882.490058:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030a00/0xbb972366037fd189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd182 expref: 10 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479882.490067:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5823:1876405551895808:0@lo:104: 00010000:00010000:0.0:1789479882.490092:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.490101:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.490115:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.490121:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030800/0xbb972366037fd270 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789479882.490135:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789479882.548545:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:6683:x1876405551895424:12345-0@lo:253: Request processed in 78505us (79043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.548581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789479882.548987:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551895424:0@lo:253: 10000000:01000000:3.0:1789479882.549004:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789479882.549007:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789479882.549009:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789479882.549011:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479882.549012:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789479882.549013:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479882.549014:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479882.549016:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789479882.549017:0:6683:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789479882.549019:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479882.549020:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789479882.549042:0:6683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d22a4535800 from lustre-OST0000 10000000:01000000:3.0:1789479882.549071:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789479882.549074:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789479882.549081:0:6683:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d229c723380 local copy 10000000:01000000:3.0:1789479882.549086:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789479882.549126:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.549213:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.549225:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.549263:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896320:0@lo:101: 00000100:00100000:3.0:1789479882.549326:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.549436:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479882.549589:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896320 00000100:00100000:2.0:1789479882.549660:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896320 00000100:00100000:2.0:1789479882.549756:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789479882.549765:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+9:6683:x1876405551896320:12345-0@lo:101: 00010000:00010000:2.0:1789479882.549780:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479882.549795:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d3000/0xbb972366037fd27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd277 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.549820:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d3000/0xbb972366037fd27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd277 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.549833:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d3000/0xbb972366037fd27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd277 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.549842:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d3000, rc 0) 00000100:00100000:2.0:1789479882.549888:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+10:6683:x1876405551896320:12345-0@lo:101: Request processed in 124us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.549895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789479882.549957:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896320:0@lo:101: 00010000:00010000:3.0:1789479882.549969:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.549978:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.550090:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896448:0@lo:501: 00000100:00100000:3.0:1789479882.550115:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.550954:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479882.551069:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896448 00000100:00100000:0.0:1789479882.551075:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896448 00000100:00100000:0.0:1789479882.551109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789479882.551117:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+10:6683:x1876405551896448:12345-0@lo:501: 00000100:00100000:0.0:1789479882.553380:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+10:6683:x1876405551896448:12345-0@lo:501: Request processed in 2253us (3253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479882.553398:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479882.553570:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896448:0@lo:501: 10000000:01000000:2.0:1789479882.553682:0:6683:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789479882.553736:0:6683:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789479882.553747:0:6683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.553758:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.553765:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.553792:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789479882.553817:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d22a4535800 10000000:01000000:2.0:1789479882.553821:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789479882.553826:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d229c723380 10000000:01000000:2.0:1789479882.553829:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789479882.553833:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d229c723380 from 1 10000000:01000000:2.0:1789479882.553835:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789479882.553868:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.553876:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.553887:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.553904:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896576:0@lo:101: 00000100:00100000:2.0:1789479882.553945:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479882.554020:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479882.554027:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.554035:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7139400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789479882.554039:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.554048:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479882.554055:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479882.554061:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479882.554087:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.554093:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479882.554114:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.554121:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd27e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.554150:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479882.554152:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479882.554154:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479882.554166:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551896704:0@lo:103: 00000100:00100000:0.0:1789479882.554196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.554378:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.554668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896576 00000100:00100000:3.0:1789479882.554676:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896576 00000100:00100000:3.0:1789479882.554692:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896704 00000100:00100000:3.0:1789479882.554694:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896704 00000100:00100000:3.0:1789479882.554776:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789479882.554788:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+11:3300:x1876405551896704:12345-0@lo:103: 00010000:00010000:3.0:1789479882.554800:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479882.554816:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d3000/0xbb972366037fd27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd277 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.554834:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479882.554915:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+10:3300:x1876405551896704:12345-0@lo:103: Request processed in 129us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.554923:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479882.555060:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551896704:0@lo:103: 00000100:00100000:3.0:1789479882.555231:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789479882.555240:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+9:6683:x1876405551896576:12345-0@lo:101: 00010000:00010000:3.0:1789479882.555254:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479882.555268:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22b7138800/0xbb972366037fd28c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd285 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.555320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22b7138800/0xbb972366037fd28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd285 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.555331:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22b7138800/0xbb972366037fd28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd285 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.555337:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22b7138800, rc 0) 00000100:00100000:3.0:1789479882.555462:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+10:6683:x1876405551896576:12345-0@lo:101: Request processed in 223us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.555468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789479882.555518:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896576:0@lo:101: 00010000:00010000:2.0:1789479882.555538:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.555546:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479882.555574:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789479882.555700:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.555711:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479882.555720:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789479882.555725:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789479882.555731:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789479882.555734:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789479882.555757:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.555764:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.555773:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.555789:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896832:0@lo:101: 00000100:00100000:2.0:1789479882.555823:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.555936:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479882.556012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896832 00000100:00100000:0.0:1789479882.556019:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896832 00000100:00100000:1.0:1789479882.556235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479882.556243:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+10:6683:x1876405551896832:12345-0@lo:101: 00010000:00010000:1.0:1789479882.556251:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479882.556262:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd293 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.556277:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd293 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.556322:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd293 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.556330:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147c00, rc 0) 00000100:00100000:1.0:1789479882.556373:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551896832:12345-0@lo:101: Request processed in 131us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.556379:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789479882.556449:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896832:0@lo:101: 00010000:00010000:2.0:1789479882.556466:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.556473:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.556584:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896960:0@lo:501: 00000100:00100000:2.0:1789479882.556625:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.556972:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.557046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551896960 00000100:00100000:3.0:1789479882.557051:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551896960 00000100:00100000:3.0:1789479882.557076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479882.557082:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551896960:12345-0@lo:501: 00000100:00100000:3.0:1789479882.557399:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551896960:12345-0@lo:501: Request processed in 315us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.557406:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789479882.557769:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551896960:0@lo:501: 00000100:00100000:2.0:1789479882.557820:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897088:0@lo:503: 00000100:00100000:2.0:1789479882.557868:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.557902:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.557984:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897088 00000100:00100000:3.0:1789479882.557988:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897088 00000100:00100000:3.0:1789479882.558010:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479882.558016:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897088:12345-0@lo:503: 00000100:00100000:3.0:1789479882.558176:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897088:12345-0@lo:503: Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.558189:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789479882.558262:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897088:0@lo:503: 00000040:00080000:2.0:1789479882.558608:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789479882.558687:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897216:0@lo:502: 00000100:00100000:2.0:1789479882.558726:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.558746:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.559893:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897216 00000100:00100000:3.0:1789479882.559904:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897216 00000100:00100000:3.0:1789479882.559952:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479882.559962:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897216:12345-0@lo:502: 00000100:00100000:3.0:1789479882.560222:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897216:12345-0@lo:502: Request processed in 261us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.560230:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789479882.560425:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897216:0@lo:502: 00000040:00080000:2.0:1789479882.560749:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789479882.560800:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789479882.560837:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789479882.560887:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789479882.560926:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789479882.560960:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789479882.560994:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897344:0@lo:502: 00000100:00100000:2.0:1789479882.561047:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.561078:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.561345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897344 00000100:00100000:3.0:1789479882.561352:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897344 00000100:00100000:3.0:1789479882.561382:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479882.561390:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897344:12345-0@lo:502: 00000100:00100000:3.0:1789479882.561715:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897344:12345-0@lo:502: Request processed in 325us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.561722:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789479882.562014:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897344:0@lo:502: 00000040:00080000:2.0:1789479882.562130:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789479882.562748:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789479882.563800:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789479882.563811:0:6701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789479882.563819:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479882.563821:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789479882.563826:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479882.563862:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d21852a99c0) 00000020:00000080:2.0:1789479882.563887:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789479882.563894:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789479882.563981:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22a4535800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789479882.563990:0:6701:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789479882.563999:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fd2a8 00010000:00010000:2.0:1789479882.573219:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789479882.573945:0:6701:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789479882.578915:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789479882.579399:0:6701:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789479882.593701:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789479882.595212:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789479882.597742:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789479882.597756:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479882.597763:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479882.597765:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789479882.597769:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479882.597773:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479882.597774:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789479882.597777:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789479882.597779:0:6701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789479882.597852:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479882.597855:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479882.597856:0:6701:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789479882.597859:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789479882.598106:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789479882.598131:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789479882.598164:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598177:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.598196:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22a4535800 from 1 10000000:01000000:3.0:1789479882.598198:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479882.598247:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598255:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598266:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.598319:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897472:0@lo:101: 00000100:00100000:3.0:1789479882.598408:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.598460:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.598490:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897472 00000100:00100000:3.0:1789479882.598499:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897472 00000100:00100000:3.0:1789479882.598548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789479882.598570:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+11:6683:x1876405551897472:12345-0@lo:101: 00010000:00010000:3.0:1789479882.598584:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479882.598611:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd2af expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598638:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd2af expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598649:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2af expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598658:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22b7138a00, rc 0) 00000100:00100000:3.0:1789479882.598706:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897472:12345-0@lo:101: Request processed in 137us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.598713:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789479882.598764:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897472:0@lo:101: 00010000:00010000:3.0:1789479882.598779:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.598787:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.598870:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897600:0@lo:501: 00000100:00100000:3.0:1789479882.598895:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.598908:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.601019:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897600 00000100:00100000:1.0:1789479882.601032:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897600 00000100:00100000:1.0:1789479882.601083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789479882.601092:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897600:12345-0@lo:501: 00000100:00100000:1.0:1789479882.601415:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897600:12345-0@lo:501: Request processed in 324us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.601426:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789479882.602061:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897600:0@lo:501: 00000100:00100000:3.0:1789479882.602124:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897728:0@lo:503: 00000100:00100000:3.0:1789479882.602206:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.602251:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.602713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897728 00000100:00100000:1.0:1789479882.602720:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897728 00000100:00100000:1.0:1789479882.602756:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479882.602765:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897728:12345-0@lo:503: 00000100:00100000:1.0:1789479882.603058:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897728:12345-0@lo:503: Request processed in 293us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.603065:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789479882.603314:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897728:0@lo:503: 00000040:00080000:3.0:1789479882.603643:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789479882.603723:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897856:0@lo:502: 00000100:00100000:3.0:1789479882.603768:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.603796:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.606922:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897856 00000100:00100000:1.0:1789479882.606944:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897856 00000100:00100000:1.0:1789479882.607052:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479882.607064:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897856:12345-0@lo:502: 00000100:00100000:1.0:1789479882.607580:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897856:12345-0@lo:502: Request processed in 516us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.607714:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897856:0@lo:502: 00000040:00080000:3.0:1789479882.608076:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789479882.608158:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789479882.608208:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897984:0@lo:502: 00000100:00100000:3.0:1789479882.608270:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.608409:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.608837:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479882.608890:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551897984 00000100:00100000:1.0:1789479882.608896:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551897984 00000100:00100000:1.0:1789479882.608937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479882.608947:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897984:12345-0@lo:502: 00000100:00100000:1.0:1789479882.611866:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551897984:12345-0@lo:502: Request processed in 2913us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.611880:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789479882.612679:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551897984:0@lo:502: 00000040:00080000:3.0:1789479882.612886:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789479882.612904:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789479882.613321:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479882.613332:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479882.613335:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789479882.613342:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22a4535800 00000020:00000080:3.0:1789479882.613345:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789479882.613366:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479882.613369:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479882.613371:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789479882.613374:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789479882.613405:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789479882.613426:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479882.613442:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.613456:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.613503:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789479882.613507:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d22a4535800 10000000:01000000:3.0:1789479882.613510:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d22a4535800 10000000:01000000:3.0:1789479882.613514:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479882.613520:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22a4535800 from 1 10000000:01000000:3.0:1789479882.613522:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479882.613567:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.613587:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.613599:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.613621:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898112:0@lo:101: 00000100:00100000:3.0:1789479882.613681:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.613721:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.615318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898112 00000100:00100000:1.0:1789479882.615330:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898112 00000100:00100000:1.0:1789479882.615392:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479882.615404:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+12:6683:x1876405551898112:12345-0@lo:101: 00010000:00010000:1.0:1789479882.615421:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479882.615438:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd2bd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.615463:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd2bd expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.615473:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2bd expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479882.615481:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147a00, rc 0) 00000100:00100000:1.0:1789479882.615571:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898112:12345-0@lo:101: Request processed in 170us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.615577:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789479882.618042:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898112:0@lo:101: 00010000:00010000:3.0:1789479882.618073:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.618086:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.618321:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898240:0@lo:501: 00000100:00100000:3.0:1789479882.618397:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.618448:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789479882.618462:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898240 00000100:00100000:0.0:1789479882.618471:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898240 00000100:00100000:0.0:1789479882.618521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789479882.618531:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898240:12345-0@lo:501: 00000100:00100000:0.0:1789479882.619197:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898240:12345-0@lo:501: Request processed in 665us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479882.619217:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789479882.620613:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898240:0@lo:501: 00000100:00100000:1.0:1789479882.620691:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898368:0@lo:503: 00000100:00100000:1.0:1789479882.620893:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479882.620996:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479882.622442:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898368 00000100:00100000:0.0:1789479882.622467:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898368 00000100:00100000:3.0:1789479882.622548:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789479882.622574:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898368:12345-0@lo:503: 00000100:00100000:3.0:1789479882.622851:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898368:12345-0@lo:503: Request processed in 280us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.622861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789479882.622967:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898368:0@lo:503: 00000040:00080000:0.0:1789479882.623384:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479882.623480:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898496:0@lo:502: 00000100:00100000:0.0:1789479882.623528:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.624310:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898496 00000100:00100000:3.0:1789479882.624319:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898496 00000100:00100000:3.0:1789479882.624370:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479882.624378:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898496:12345-0@lo:502: 00000100:00100000:0.0:1789479882.624502:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545000 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.624678:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898496:12345-0@lo:502: Request processed in 298us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.624688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789479882.624780:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898496:0@lo:502: 00000040:00080000:0.0:1789479882.625131:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789479882.625385:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789479882.625429:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789479882.625477:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789479882.625515:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789479882.625578:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789479882.625621:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789479882.625655:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789479882.625711:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789479882.625765:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789479882.625809:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789479882.625877:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789479882.625919:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789479882.625976:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789479882.626020:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789479882.626055:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789479882.626088:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789479882.626134:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789479882.626390:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789479882.626431:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789479882.626481:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789479882.626514:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789479882.626539:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789479882.626603:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789479882.626636:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789479882.626663:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789479882.626702:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789479882.626730:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789479882.626772:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898624:0@lo:502: 00000100:00100000:1.0:1789479882.626841:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479882.626881:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.627013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898624 00000100:00100000:3.0:1789479882.627020:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898624 00000100:00100000:3.0:1789479882.627072:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479882.627081:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898624:12345-0@lo:502: 00000100:00100000:3.0:1789479882.627327:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551898624:12345-0@lo:502: Request processed in 245us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.627336:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789479882.627502:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551898624:0@lo:502: 00000040:00080000:1.0:1789479882.627586:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789479882.627663:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789479882.630017:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789479882.630037:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d22b99c0000) 00000020:00000080:0.0:1789479882.630060:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789479882.630296:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22a4535800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789479882.630302:0:6706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22a4535800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789479882.630305:0:6706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22a4535800 3 00010000:00080000:0.0:1789479882.630339:0:6706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2185560000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789479882.638386:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789479882.639351:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789479882.639404:0:6706:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789479882.639419:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb972366037fd2d2 00000100:00080000:1.0:1789479882.639432:0:6706:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479882.639447:0:6706:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2185560000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789479882.639488:0:6706:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22c1e7c380 x1876405551898752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479882.639518:0:6706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789479882.640013:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551898752:0@lo:38: 00000100:00100000:3.0:1789479882.640097:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479882.640107:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479882.640134:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551898880:0@lo:400: 00000100:00100000:0.0:1789479882.640169:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.640438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898752 00000100:00100000:3.0:1789479882.640449:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898752 00000100:00100000:3.0:1789479882.640481:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551898880 00000100:00100000:3.0:1789479882.640484:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551898880 00000100:00100000:3.0:1789479882.640513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479882.640522:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551898880:12345-0@lo:400: 00000100:00100000:3.0:1789479882.640586:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551898880:12345-0@lo:400: Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.642227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479882.642261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479882.642268:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405551898752:12345-0@lo:38: 00010000:00080000:3.0:1789479882.642324:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1789479882.642360:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb972366037fd2d9 00000004:00100000:3.0:1789479882.642388:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789479882.642422:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8d22bfd48000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479882.642520:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876405551898752:12345-0@lo:38: Request processed in 251us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.642527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789479882.642742:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1789479882.643977:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22a4996d80 x1876405551898880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479882.643997:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551898880:0@lo:400: 00000020:01000000:2.0:1789479882.645939:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789479882.645993:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479882.646037:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.646051:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789479882.646111:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789479882.646113:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479882.646115:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479882.646116:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479882.646118:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479882.646119:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479882.646121:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479882.646123:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479882.646124:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479882.646126:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479882.646127:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789479882.646142:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789479882.646145:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789479882.646147:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479882.646148:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479882.646149:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479882.646151:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479882.646152:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479882.646153:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479882.646155:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479882.646156:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479882.646157:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479882.646158:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789479882.646201:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789479882.646223:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551899008:0@lo:253: 00010000:00080000:1.0:1789479882.649670:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22c1e7c380 x1876405551898752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479882.649695:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789479882.649707:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789479882.649718:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789479882.649725:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789479882.649729:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479882.649737:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551898752:0@lo:38: 00000100:00100000:2.0:1789479882.650546:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.650618:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.650767:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899008 00000100:00100000:1.0:1789479882.650779:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899008 00000100:00100000:1.0:1789479882.650852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789479882.650862:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551899008:12345-0@lo:253: 20000000:01000000:1.0:1789479882.650901:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789479882.650920:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789479882.704075:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789479882.704099:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789479882.704169:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789479882.704175:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789479882.704210:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.704230:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd238 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.704239:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.704325:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.704340:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 13 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479882.704355:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48aed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551899136:0@lo:104: 00000100:00100000:2.0:1789479882.704430:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.704500:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789479882.704576:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899136 00000100:00100000:0.0:1789479882.704584:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899136 00000100:00100000:0.0:1789479882.704641:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789479882.704651:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551899136:12345-0@lo:104: 00010000:00010000:0.0:1789479882.704665:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479882.704741:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479882.704749:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551899136:12345-0@lo:104: Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479882.704757:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479882.705006:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48aed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551899136:0@lo:104: 00010000:00010000:2.0:1789479882.705028:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705092:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479882.705100:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705107:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479882.705111:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705121:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479882.705129:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479882.705135:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479882.705178:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705186:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479882.705217:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705224:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2146000/0xbb972366037fd238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd23f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705254:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479882.705256:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479882.705258:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479882.705269:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789479882.705313:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551899264:0@lo:103: 00000100:00100000:3.0:1789479882.705352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.705390:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899264 00000100:00100000:3.0:1789479882.705396:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899264 00010000:00010000:3.0:1789479882.705415:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 14 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479882.705438:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479882.705444:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+14:3299:x1876405551899264:12345-0@lo:103: 00010000:00010000:3.0:1789479882.705562:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479882.705569:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 14 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705580:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 14 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705716:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2600/0xbb972366037fd23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd238 expref: 14 pid: 5824 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705730:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705739:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789479882.705763:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001589272s 00010000:00010000:3.0:1789479882.705768:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705775:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705782:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705788:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705793:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789479882.705797:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.705806:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.707780:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479882.707798:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479882.714909:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:6683:x1876405551899008:12345-0@lo:253: Request processed in 64032us (64348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.714929:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789479882.715052:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:6683:1876405551899008:0@lo:253: 10000000:01000000:2.0:1789479882.715073:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789479882.715094:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789479882.715096:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479882.715098:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479882.715100:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479882.715101:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479882.715103:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479882.715104:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479882.715106:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479882.715108:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479882.715109:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479882.715110:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789479882.715128:0:6683:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789479882.716397:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.716420:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd2e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479882.716446:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479882.716570:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+12:3299:x1876405551899264:12345-0@lo:103: Request processed in 11123us (11215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.716580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789479882.716817:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551899264:0@lo:103: 00080000:10000000:2.0:1789479882.726219:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789479882.727342:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789479882.728839:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789479882.730961:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789479882.731977:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789479882.734979:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789479882.736512:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789479882.778842:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789479883.000717:0:6683:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789479883.000727:0:6683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789479883.000766:0:6683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789479883.000835:0:6683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789479883.000851:0:6683:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789479883.000881:0:6683:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789479883.803470:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789479884.767204:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789479884.767214:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22aea50800 from 21 10000000:01000000:3.0:1789479884.767222:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479884.767298:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.767312:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.768543:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479884.768591:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899392:0@lo:101: 00000100:00100000:3.0:1789479884.768685:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479884.768746:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479884.774596:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899392 00000100:00100000:0.0:1789479884.774620:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899392 00000100:00100000:0.0:1789479884.774703:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479884.774715:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551899392:12345-0@lo:101: 00010000:00010000:0.0:1789479884.774738:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479884.774762:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd2e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479884.774801:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479884.774824:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479884.774835:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280030400, rc 0) 00000100:00100000:0.0:1789479884.774939:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551899392:12345-0@lo:101: Request processed in 226us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479884.774946:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479884.775035:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899392:0@lo:101: 00010000:00010000:0.0:1789479884.775059:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479884.775072:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479884.775545:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899520:0@lo:501: 00000100:00100000:0.0:1789479884.775653:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479884.776210:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479884.776625:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899520 00000100:00100000:1.0:1789479884.776636:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899520 00000100:00100000:1.0:1789479884.776686:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789479884.776695:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551899520:12345-0@lo:501: 00000100:00100000:1.0:1789479884.777560:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551899520:12345-0@lo:501: Request processed in 860us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479884.777571:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789479884.778308:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899520:0@lo:501: 00000100:00100000:3.0:1789479884.778754:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899648:0@lo:503: 00000100:00100000:3.0:1789479884.778833:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479884.778890:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479884.779249:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899648 00000100:00100000:1.0:1789479884.779260:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899648 00000100:00100000:1.0:1789479884.781885:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789479884.781907:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551899648:12345-0@lo:503: 00000100:00100000:1.0:1789479884.782220:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551899648:12345-0@lo:503: Request processed in 320us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479884.782229:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789479884.782594:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551899648:0@lo:503: 00000100:00100000:1.0:1789479884.783142:0:6792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6792:1876405551899776:0@lo:502: 00000100:00100000:1.0:1789479884.784648:0:6792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479884.784716:0:6792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.787242:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899776 00000100:00100000:3.0:1789479884.787260:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899776 00000100:00100000:3.0:1789479884.787358:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789479884.787371:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:6792:x1876405551899776:12345-0@lo:502: 00000100:00100000:3.0:1789479884.787763:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:6792:x1876405551899776:12345-0@lo:502: Request processed in 393us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.787773:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789479884.788178:0:6792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6792:1876405551899776:0@lo:502: 00000100:00100000:1.0:1789479884.788269:0:6792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6792:1876405551899904:0@lo:502: 00000100:00100000:1.0:1789479884.788369:0:6792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479884.788406:0:6792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789479884.788531:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551899904 00000100:00100000:0.0:1789479884.788538:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551899904 00000100:00100000:0.0:1789479884.788590:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789479884.788599:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6792:x1876405551899904:12345-0@lo:502: 00000100:00100000:0.0:1789479884.788818:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:6792:x1876405551899904:12345-0@lo:502: Request processed in 220us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479884.788824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479884.789677:0:6792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6792:1876405551899904:0@lo:502: 00000040:00080000:1.0:1789479884.789720:0:6792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789479884.791217:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789479884.791257:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479884.791270:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.791519:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479884.792595:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789479884.792604:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d22aea50800 from 4 10000000:01000000:1.0:1789479884.792610:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479884.792674:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479884.792686:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479884.792701:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479884.792730:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900032:0@lo:101: 00000100:00100000:1.0:1789479884.792838:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479884.792891:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.793078:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900032 00000100:00100000:3.0:1789479884.793104:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900032 00000100:00100000:3.0:1789479884.793172:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789479884.793183:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551900032:12345-0@lo:101: 00010000:00010000:3.0:1789479884.793201:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479884.793221:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd2f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.793252:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.793265:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.793275:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22b7138200, rc 0) 00000100:00100000:3.0:1789479884.793380:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551900032:12345-0@lo:101: Request processed in 198us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.793387:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789479884.793625:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900032:0@lo:101: 00010000:00010000:2.0:1789479884.793656:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.793667:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479884.793732:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900160:0@lo:256: 00000100:00100000:2.0:1789479884.793772:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479884.793801:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.794221:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900160 00000100:00100000:3.0:1789479884.794228:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900160 00000100:00100000:3.0:1789479884.794273:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789479884.794313:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551900160:12345-0@lo:256: 20000000:01000000:3.0:1789479884.794344:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789479884.794370:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789479884.794374:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789479884.794478:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551900160:12345-0@lo:256: Request processed in 197us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.794486:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789479884.794887:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900160:0@lo:256: 10000000:01000000:2.0:1789479884.794959:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789479884.794981:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.794994:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479884.795005:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789479884.795008:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789479884.795011:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789479884.795042:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.795052:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.795063:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479884.795108:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900288:0@lo:101: 00000100:00100000:2.0:1789479884.795146:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479884.795179:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.795952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900288 00000100:00100000:3.0:1789479884.795984:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900288 00000100:00100000:3.0:1789479884.796045:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789479884.796056:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551900288:12345-0@lo:101: 00010000:00010000:3.0:1789479884.796070:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479884.796119:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd303 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.796151:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd303 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.796164:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd303 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479884.796175:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5000, rc 0) 00000100:00100000:3.0:1789479884.796244:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551900288:12345-0@lo:101: Request processed in 191us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.796251:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789479884.796404:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900288:0@lo:101: 00010000:00010000:2.0:1789479884.796426:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479884.796436:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479884.796506:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900416:0@lo:501: 00000100:00100000:2.0:1789479884.796549:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479884.796595:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789479884.796820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900416 00000100:00100000:1.0:1789479884.796826:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900416 00000100:00100000:1.0:1789479884.796866:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789479884.796873:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551900416:12345-0@lo:501: 00000100:00100000:1.0:1789479884.797220:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551900416:12345-0@lo:501: Request processed in 345us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479884.797229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789479884.797437:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900416:0@lo:501: 00000100:00100000:2.0:1789479884.797475:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900544:0@lo:503: 00000100:00100000:2.0:1789479884.797527:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479884.797555:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.797698:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900544 00000100:00100000:3.0:1789479884.797704:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900544 00000100:00100000:3.0:1789479884.797735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479884.797743:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551900544:12345-0@lo:503: 00000100:00100000:3.0:1789479884.798006:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551900544:12345-0@lo:503: Request processed in 262us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.798013:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789479884.798322:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551900544:0@lo:503: 00000100:00100000:2.0:1789479884.798904:0:6793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6793:1876405551900672:0@lo:502: 00000100:00100000:2.0:1789479884.798963:0:6793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479884.799018:0:6793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.799229:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900672 00000100:00100000:3.0:1789479884.799236:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900672 00000100:00100000:3.0:1789479884.799311:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789479884.799322:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:6793:x1876405551900672:12345-0@lo:502: 00000100:00100000:3.0:1789479884.799840:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:6793:x1876405551900672:12345-0@lo:502: Request processed in 519us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.799856:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789479884.810695:0:6793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6793:1876405551900672:0@lo:502: 00000020:01000000:1.0:1789479884.810889:0:6793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789479884.810899:0:6793:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789479884.810916:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479884.810918:0:6793:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789479884.810926:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789479884.810930:0:6793:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1789479884.810980:0:6793:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789479884.810984:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789479884.811007:0:6793:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d22bd6b0000) 00000020:00000080:1.0:1789479884.811040:0:6793:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789479884.811048:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789479884.811648:0:6793:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789479884.811660:0:6793:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789479884.811671:0:6793:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd318 00010000:00080000:1.0:1789479884.811740:0:6793:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22925b4000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789479884.812736:0:6793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1789479884.828159:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789479884.979767:0:6793:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789479884.979804:0:6793:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789479884.980547:0:6793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479884.981208:0:6793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479884.981275:0:6793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789479884.981392:0:6793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789479884.987379:0:6805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789479884.987395:0:6805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789479884.992928:0:6793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789479884.992950:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789479884.993004:0:6793:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789479884.993035:0:6793:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fd31f 00000100:00080000:1.0:1789479884.993050:0:6793:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479884.993065:0:6793:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d22925b4000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789479884.993128:0:6793:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22c1e7ed80 x1876405551900800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479884.993161:0:6793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789479884.993224:0:6793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479884.993228:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479884.993230:0:6793:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789479884.993232:0:6793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479884.993236:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479884.993238:0:6793:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479884.993241:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479884.993243:0:6793:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789479884.993277:0:6793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6793:1876405551900928:0@lo:502: 00000100:00100000:1.0:1789479884.993412:0:6793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479884.993473:0:6793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776840 going to sleep for 11 seconds 00000100:00100000:3.0:1789479884.993666:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551900800:0@lo:8: 00000100:00100000:3.0:1789479884.993712:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479884.993801:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900928 00000100:00100000:1.0:1789479884.993810:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900928 00000100:00100000:1.0:1789479884.993863:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789479884.993876:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:6793:x1876405551900928:12345-0@lo:502: 00000100:00100000:1.0:1789479884.995986:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:6793:x1876405551900928:12345-0@lo:502: Request processed in 2094us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479884.996005:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789479884.999207:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551900800 00000100:00100000:1.0:1789479884.999401:0:6793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:6793:1876405551900928:0@lo:502: 00000020:01000000:1.0:1789479884.999464:0:6793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479884.999474:0:6793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479884.999477:0:6793:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479884.999482:0:6793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1789479884.999661:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551900800 00000100:00100000:0.0:1789479884.999712:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479884.999721:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551900800:12345-0@lo:8: 00010000:00080000:0.0:1789479884.999755:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1789479884.999790:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fd326 00002000:00100000:0.0:1789479884.999845:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2185565000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789479884.999850:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789479884.999856:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1789479885.000776:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789479885.000810:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789479885.000860:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479885.000877:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479885.000890:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789479885.000893:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d229c723380 from 1 10000000:01000000:1.0:1789479885.000897:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789479885.000944:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479885.000953:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479885.000965:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479885.000993:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551901184:0@lo:101: 00000100:00100000:1.0:1789479885.001080:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1789479885.001749:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789479885.001995:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789479885.002039:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d2185564800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479885.002767:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901184 00000100:00100000:2.0:1789479885.002779:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901184 00000100:00100000:2.0:1789479885.002833:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789479885.002845:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551901184:12345-0@lo:101: 00010000:00010000:2.0:1789479885.002872:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479885.002894:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd32d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479885.002928:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd32d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479885.002941:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd32d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479885.002951:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2800, rc 0) 00000100:00100000:1.0:1789479885.005665:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479885.005713:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479885.005736:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551901312:0@lo:400: 00000100:00100000:1.0:1789479885.005821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479885.006013:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901312 00000100:00100000:3.0:1789479885.006025:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901312 00000100:00100000:3.0:1789479885.006114:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479885.006126:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551901312:12345-0@lo:400: 00000100:00100000:3.0:1789479885.006197:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551901312:12345-0@lo:400: Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479885.006204:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479885.006651:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551901184:12345-0@lo:101: Request processed in 3805us (5567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479885.006660:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789479885.006757:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551901184:0@lo:101: 00010000:00010000:2.0:1789479885.006787:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479885.006802:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479885.006893:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551901440:0@lo:501: 00000100:00100000:2.0:1789479885.006927:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479885.006965:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c80c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789479885.007055:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789479885.007084:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48aca80 x1876405551901312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479885.007165:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551901312:0@lo:400: 00000100:00100000:3.0:1789479885.007221:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901440 00000100:00100000:3.0:1789479885.007227:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901440 00000100:00100000:1.0:1789479885.007354:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479885.007365:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551901056:0@lo:400: 00000100:00100000:1.0:1789479885.007399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479885.007527:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789479885.007536:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551901440:12345-0@lo:501: 00000100:00100000:2.0:1789479885.008204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901056 00000100:00100000:2.0:1789479885.008213:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901056 00000100:00100000:2.0:1789479885.008389:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479885.008398:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551901056:12345-0@lo:400: 00000100:00100000:2.0:1789479885.008476:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551901056:12345-0@lo:400: Request processed in 80us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479885.008483:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789479885.008607:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48aed80 x1876405551901056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479885.008623:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551901056:0@lo:400: 00000100:00100000:3.0:1789479885.008793:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551901440:12345-0@lo:501: Request processed in 1258us (1864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789479885.008802:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789479885.009198:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551901440:0@lo:501: 10000000:01000000:2.0:1789479885.009648:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789479885.009661:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479885.009675:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479885.011412:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405551900800:12345-0@lo:8: Request processed in 11679us (17687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479885.011429:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789479885.015553:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7ed80 x1876405551900800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479885.015583:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789479885.015598:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789479885.015612:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789479885.015620:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789479885.015624:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22925b4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789479885.015651:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789479885.015660:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551900800:0@lo:8: 00000004:00080000:2.0:1789479885.015921:0:6805:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789479885.016136:0:6805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178012852288ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789479885.168273:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789479885.264456:0:6808:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789479885.264510:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901696:0@lo:7: 00000100:00100000:1.0:1789479885.264610:0:6808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479885.264677:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22837766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479885.264714:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551901568:0@lo:13: 00000100:00100000:1.0:1789479885.264761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479885.264819:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901696 00000100:00100000:1.0:1789479885.264828:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901696 00000100:00100000:1.0:1789479885.264894:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479885.264906:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6808:x1876405551901696:12345-0@lo:7: 00000100:00080000:0.0:1789479885.267395:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479885.267435:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901568 00000100:00100000:0.0:1789479885.267447:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901568 00000100:00100000:0.0:1789479885.267526:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479885.267538:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551901568:12345-0@lo:13: 00002000:00000024:0.0:1789479885.267587:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789479885.267694:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551901568:12345-0@lo:13: Request processed in 158us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479885.267702:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789479885.269458:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7ed80 x1876405551901568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479885.269491:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551901568:0@lo:13: 00002000:00080000:2.0:1789479885.281995:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789479885.282007:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789479885.282133:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6808:x1876405551901696:12345-0@lo:7: Request processed in 17223us (17517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479885.282148:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789479885.282666:0:6808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7fb80 x1876405551901696/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479901 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479885.282686:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901696:0@lo:7: 00000004:00080000:1.0:1789479885.282704:0:6808:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789479885.282756:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901824:0@lo:5: 00000100:00100000:1.0:1789479885.282802:0:6808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479885.282850:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22837766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479885.282961:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901824 00000100:00100000:0.0:1789479885.282970:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901824 00000100:00100000:0.0:1789479885.283022:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479885.283033:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6808:x1876405551901824:12345-0@lo:5: 00002000:00080000:0.0:1789479885.283070:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789479885.283076:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789479885.283727:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6808:x1876405551901824:12345-0@lo:5: Request processed in 692us (921us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789479885.283737:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789479885.287433:0:6808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7fb80 x1876405551901824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479901 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479885.287461:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901824:0@lo:5: 00000004:00080000:1.0:1789479885.287483:0:6808:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789479885.288237:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901952:0@lo:700: 00000100:00100000:2.0:1789479885.288872:0:6808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479885.289030:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789479885.291535:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551901952 00000100:00100000:3.0:1789479885.291554:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551901952 00000100:00100000:2.0:1789479885.297276:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479885.297322:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6808:x1876405551901952:12345-0@lo:700: 00000100:00100000:2.0:1789479885.297412:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876405551902080:0@lo:700: 00000100:00100000:2.0:1789479885.297512:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479885.297680:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479885.297711:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902080 00000100:00100000:2.0:1789479885.297721:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902080 00000100:00100000:2.0:1789479885.297774:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479885.297780:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876405551902080:12345-0@lo:700: 00000100:00100000:1.0:1789479885.298199:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1789479885.298240:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 40000000:02000000:0.0:1789479885.397340:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789479885.417064:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876405551902080:12345-0@lo:700: Request processed in 119272us (119549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479885.417111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789479885.417490:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ac700 x1876405551902080/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789479901 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479885.417523:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876405551902080:0@lo:700: 40000000:02000000:3.0:1789479885.417551:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1789479885.530566:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789479885.530591:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789479885.533101:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6808:x1876405551901952:12345-0@lo:700: Request processed in 235706us (244150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479885.533121:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789479885.533214:0:6808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ae300 x1876405551901952/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479901 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479885.533228:0:6808:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789479885.533248:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551901952:0@lo:700: 00000004:02000040:2.0:1789479885.584460:0:6808:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789479885.593722:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551902208:0@lo:5: 00000100:00100000:2.0:1789479885.593813:0:6808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479885.593895:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479885.595384:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902208 00000100:00100000:3.0:1789479885.595401:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902208 00000100:00100000:3.0:1789479885.595488:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479885.595510:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6808:x1876405551902208:12345-0@lo:5: 00002000:00080000:3.0:1789479885.605810:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789479885.605841:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789479885.618080:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6808:x1876405551902208:12345-0@lo:5: Request processed in 22559us (24253us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789479885.618105:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789479885.620631:0:6808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ae300 x1876405551902208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479901 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479885.620661:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6808:1876405551902208:0@lo:5: 00000004:00080000:0.0:1789479885.620683:0:6808:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789479885.852897:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479886.874554:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479887.898581:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479888.924367:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479889.947014:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479890.266759:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551902720:0@lo:400: 00000100:00100000:2.0:1789479890.266760:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551902336:0@lo:400: 00000100:00100000:2.0:1789479890.273418:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479890.273517:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479890.273534:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551902464:0@lo:400: 00000100:00100000:2.0:1789479890.273583:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479890.273734:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479890.273765:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479890.273773:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551902592:0@lo:400: 00000100:00100000:0.0:1789479890.273801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479890.273839:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902720 00000100:00100000:0.0:1789479890.273849:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902720 00000100:00100000:0.0:1789479890.273944:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479890.273955:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876405551902720:12345-0@lo:400: 00000100:00100000:0.0:1789479890.274021:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876405551902720:12345-0@lo:400: Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479890.274041:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479890.274268:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902336 00000100:00100000:2.0:1789479890.274273:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902336 00000100:00100000:2.0:1789479890.274333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789479890.274340:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:3298:x1876405551902336:12345-0@lo:400: 00000100:00100000:2.0:1789479890.274384:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:3298:x1876405551902336:12345-0@lo:400: Request processed in 44us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479890.274390:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789479890.274441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902464 00000100:00100000:2.0:1789479890.274453:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902464 00000100:00100000:2.0:1789479890.274484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902592 00000100:00100000:2.0:1789479890.274487:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902592 00000100:00100000:2.0:1789479890.274507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479890.274513:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551902464:12345-0@lo:400: 00000100:00100000:2.0:1789479890.274548:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551902464:12345-0@lo:400: Request processed in 34us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479890.274554:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479890.274566:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479890.274572:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551902592:12345-0@lo:400: 00000100:00100000:2.0:1789479890.274598:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551902592:12345-0@lo:400: Request processed in 27us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479890.274604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789479890.276500:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479890.276513:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789479890.276600:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48af100 x1876405551902592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789479890.276759:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ae680 x1876405551902464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479890.276775:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551902464:0@lo:400: 00000100:00100000:2.0:1789479890.276789:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551902336:0@lo:400: 00000100:00100000:0.0:1789479890.276902:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551902592:0@lo:400: 00010000:00080000:0.0:1789479890.276920:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ac700 x1876405551902720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479890.276929:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551902720:0@lo:400: 00000100:00100000:1.0:1789479890.782324:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479890.782358:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551902848:0@lo:13: 00000100:00100000:1.0:1789479890.782457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479890.789507:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902848 00000100:00100000:0.0:1789479890.789524:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902848 00000100:00100000:0.0:1789479890.789603:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479890.789615:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551902848:12345-0@lo:13: 00002000:00000024:0.0:1789479890.789672:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479890.789778:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551902848:12345-0@lo:13: Request processed in 165us (7319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479890.789785:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789479890.789871:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7fb80 x1876405551902848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479890.789896:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551902848:0@lo:13: 00000001:00080000:0.0:1789479890.892127:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789479890.971543:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789479890.992310:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789479891.996448:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479893.021507:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479894.043253:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479895.071362:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479895.388353:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551903360:0@lo:400: 00000100:00100000:2.0:1789479895.388442:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551903104:0@lo:400: 00000100:00100000:2.0:1789479895.388513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479895.388573:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479895.388593:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479895.388600:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551903232:0@lo:400: 00000100:00100000:3.0:1789479895.388605:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479895.388610:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551902976:0@lo:400: 00000100:00100000:2.0:1789479895.388620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479895.388637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479895.388657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903104 00000100:00100000:2.0:1789479895.388666:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903104 00000100:00100000:3.0:1789479895.388678:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903360 00000100:00100000:3.0:1789479895.388681:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903360 00000100:00100000:2.0:1789479895.388717:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903232 00000100:00100000:3.0:1789479895.388725:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479895.388727:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903232 00000100:00100000:3.0:1789479895.388733:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551903360:12345-0@lo:400: 00000100:00100000:2.0:1789479895.388745:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479895.388750:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551903104:12345-0@lo:400: 00000100:00100000:2.0:1789479895.388805:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551903104:12345-0@lo:400: Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479895.388814:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479895.388835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479895.388841:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551903232:12345-0@lo:400: 00000100:00100000:2.0:1789479895.388868:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551903232:12345-0@lo:400: Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479895.388873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789479895.388918:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48aca80 x1876405551903232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479895.388934:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551903232:0@lo:400: 00010000:00080000:2.0:1789479895.388946:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ae680 x1876405551903104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479895.388955:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551903104:0@lo:400: 00000100:00100000:3.0:1789479895.389004:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551903360:12345-0@lo:400: Request processed in 271us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479895.389011:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479895.389031:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551902976 00000100:00100000:3.0:1789479895.389035:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551902976 00000100:00100000:3.0:1789479895.389072:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789479895.389078:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:3298:x1876405551902976:12345-0@lo:400: 00000100:00100000:3.0:1789479895.389110:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:3298:x1876405551902976:12345-0@lo:400: Request processed in 32us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479895.389116:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789479895.389142:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479895.389147:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479895.389172:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551902976:0@lo:400: 00010000:00080000:3.0:1789479895.389182:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ad880 x1876405551903360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479895.389190:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789479895.389201:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551903360:0@lo:400: 00000100:00100000:3.0:1789479895.901764:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551903488:0@lo:13: 00000100:00100000:3.0:1789479895.901891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479895.902098:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903488 00000100:00100000:3.0:1789479895.902109:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903488 00000100:00100000:3.0:1789479895.902180:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479895.902192:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551903488:12345-0@lo:13: 00002000:00000024:3.0:1789479895.902243:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479895.902345:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551903488:12345-0@lo:13: Request processed in 155us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479895.902357:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789479895.902510:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48ae680 x1876405551903488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479895.902797:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551903488:0@lo:13: 00010000:00010000:3.0:1789479896.091038:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479897.115431:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479898.140432:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479899.165873:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479900.209005:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479900.510726:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551903872:0@lo:400: 00000100:00100000:1.0:1789479900.510831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479900.510896:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479900.510919:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551904000:0@lo:400: 00000100:00100000:1.0:1789479900.510950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479900.511313:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551903616:0@lo:400: 00000100:00100000:2.0:1789479900.511352:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479900.511385:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479900.511399:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551903744:0@lo:400: 00000100:00100000:2.0:1789479900.511442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479900.511480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903872 00000100:00100000:2.0:1789479900.511489:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903872 00000100:00100000:2.0:1789479900.511552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903744 00000100:00100000:2.0:1789479900.511556:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903744 00000100:00100000:2.0:1789479900.511574:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479900.511582:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551903872:12345-0@lo:400: 00000100:00100000:2.0:1789479900.511641:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551903872:12345-0@lo:400: Request processed in 60us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479900.511649:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479900.511670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479900.511677:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551903744:12345-0@lo:400: 00000100:00100000:2.0:1789479900.511708:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551903744:12345-0@lo:400: Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479900.511714:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789479900.511732:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789479900.511759:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7c380 x1876405551903744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479900.511773:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551903744:0@lo:400: 00010000:00080000:2.0:1789479900.511929:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7c000 x1876405551903872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479900.511939:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551903872:0@lo:400: 00000100:00100000:1.0:1789479900.512025:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551903616 00000100:00100000:1.0:1789479900.512029:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551903616 00000100:00100000:1.0:1789479900.512058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789479900.512065:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:3300:x1876405551903616:12345-0@lo:400: 00000100:00100000:1.0:1789479900.514006:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:3300:x1876405551903616:12345-0@lo:400: Request processed in 1930us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479900.514019:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789479900.514137:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551903616:0@lo:400: 00000100:00100000:1.0:1789479900.514373:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904000 00000100:00100000:1.0:1789479900.514380:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904000 00000100:00100000:1.0:1789479900.514448:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479900.514459:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551904000:12345-0@lo:400: 00000100:00100000:1.0:1789479900.514508:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551904000:12345-0@lo:400: Request processed in 52us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479900.514514:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789479900.514562:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479900.514589:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22c1e7df80 x1876405551904000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479900.514616:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551904000:0@lo:400: 00000100:00100000:3.0:1789479901.018450:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551904128:0@lo:13: 00000100:00100000:3.0:1789479901.018545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479901.018901:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904128 00000100:00100000:2.0:1789479901.018912:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904128 00000100:00100000:2.0:1789479901.018965:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479901.018975:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551904128:12345-0@lo:13: 00002000:00000024:2.0:1789479901.019016:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479901.019076:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551904128:12345-0@lo:13: Request processed in 102us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479901.019083:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789479901.019180:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a48aca80 x1876405551904128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479901.019235:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551904128:0@lo:13: 00010000:00010000:2.0:1789479901.217276:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479902.234794:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479903.259894:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479904.282946:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789479904.611529:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789479904.611534:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789479904.611687:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d22b9aa2800 00000020:01000004:3.0:1789479904.611727:0:7631:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789479904.611741:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789479904.611764:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d22a4accd40) 00000020:00000080:3.0:1789479904.611782:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789479904.656102:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789479904.656433:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789479904.715471:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789479904.735606:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789479904.735647:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789479904.736144:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789479904.736183:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789479904.737524:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789479904.737543:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789479904.737559:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fd342 00000020:01000004:2.0:1789479904.737569:0:7631:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789479904.737597:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789479904.737602:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789479904.737608:0:7631:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789479904.737634:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789479904.737639:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789479904.851474:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789479904.851529:0:7631:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789479904.851534:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789479904.851536:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789479904.851537:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479904.851539:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479904.851540:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479904.851541:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479904.851542:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789479904.851544:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479904.851545:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479904.851546:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479904.851548:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479904.851551:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789479904.851553:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789479904.851555:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789479904.851556:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479904.851557:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479904.851558:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479904.851559:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479904.851560:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789479904.851561:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479904.851562:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479904.851563:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479904.851564:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479904.851589:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789479904.852065:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551904256:0@lo:253: 00000100:00100000:3.0:1789479904.852171:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479904.852315:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22baa7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479904.853763:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904256 00000100:00100000:2.0:1789479904.853775:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904256 00000100:00100000:2.0:1789479904.853960:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789479904.853983:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:7631:x1876405551904256:12345-0@lo:253: 20000000:01000000:2.0:1789479904.854037:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789479904.854042:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789479904.854049:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789479904.854052:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789479904.860156:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479904.867239:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789479904.867274:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789479904.867372:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789479904.870164:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789479904.870345:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789479904.872645:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789479904.873250:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789479904.873275:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:2.0:1789479904.873278:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789479904.873337:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789479904.873345:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479904.874583:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789479904.874604:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1789479904.874788:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789479904.874800:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789479904.874834:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789479904.879231:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789479904.883699:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789479904.883736:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:2.0:1789479904.883739:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:2.0:1789479904.883776:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789479904.883784:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789479904.883813:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789479904.883820:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:2.0:1789479904.883849:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789479904.883868:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789479904.883932:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789479904.883973:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789479904.883991:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789479904.883994:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789479904.883999:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789479904.885561:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789479904.885567:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789479904.885827:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789479904.885832:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789479904.895528:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789479904.896963:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789479904.897032:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789479904.897159:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789479904.897179:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789479904.897182:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789479904.904585:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789479904.904699:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789479904.904760:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789479904.905586:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789479904.905650:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789479904.905715:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789479904.905732:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789479904.905735:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789479904.906898:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789479904.906988:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789479904.907028:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789479904.907431:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789479904.907480:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789479904.907534:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789479904.907548:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789479904.907551:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789479904.908489:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789479904.908566:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789479904.908640:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789479904.909191:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789479904.909235:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789479904.909272:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789479904.909316:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789479904.909319:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789479904.909330:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479904.909354:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909482:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd293 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909494:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2bd expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909500:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909507:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd303 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909527:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd32d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909535:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909579:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.909597:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 16 pid: 5824 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479904.909775:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904384:0@lo:104: 00000100:00100000:0.0:1789479904.910787:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479904.910958:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.910971:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 16 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479904.910983:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4994700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904512:0@lo:104: 00010000:00010000:0.0:1789479904.911027:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.911036:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 16 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479904.911044:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904640:0@lo:104: 00010000:00010000:0.0:1789479904.911070:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.911091:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 16 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479904.911099:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904768:0@lo:104: 00010000:00010000:0.0:1789479904.911139:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479904.911148:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 16 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479904.911156:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4994e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904896:0@lo:104: 00000100:00100000:0.0:1789479904.911174:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283a55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479904.911279:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789479904.911330:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479904.911351:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479904.911358:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479904.911366:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479904.911387:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904384 00000100:00100000:1.0:1789479904.911394:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904384 00000100:00100000:1.0:1789479904.911432:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904512 00000100:00100000:1.0:1789479904.911435:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904512 00000100:00100000:1.0:1789479904.911445:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904640 00000100:00100000:1.0:1789479904.911447:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904640 00000100:00100000:1.0:1789479904.911466:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904768 00000100:00100000:1.0:1789479904.911468:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904768 00000100:00100000:1.0:1789479904.911476:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551904896 00000100:00100000:1.0:1789479904.911478:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551904896 00000100:00100000:1.0:1789479904.911490:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479904.911500:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d229c5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+7:5824:x1876405551904384:12345-0@lo:104: 00010000:00010000:1.0:1789479904.911513:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479904.911587:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789479904.911593:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d229c5dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+7:5824:x1876405551904384:12345-0@lo:104: Request processed in 96us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.911600:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479904.911769:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789479904.911776:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+6:5824:x1876405551904512:12345-0@lo:104: 00010000:00010000:1.0:1789479904.911784:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479904.911817:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789479904.911822:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+6:5824:x1876405551904512:12345-0@lo:104: Request processed in 48us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.911828:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789479904.911840:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479904.911846:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+5:5824:x1876405551904640:12345-0@lo:104: 00010000:00010000:1.0:1789479904.911927:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479904.911958:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789479904.911970:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+5:5824:x1876405551904640:12345-0@lo:104: Request processed in 125us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.911976:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479904.911989:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479904.911994:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:5824:x1876405551904768:12345-0@lo:104: 00010000:00010000:1.0:1789479904.912001:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479904.912026:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789479904.912031:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:5824:x1876405551904768:12345-0@lo:104: Request processed in 38us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.912037:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479904.912048:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789479904.912053:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:5824:x1876405551904896:12345-0@lo:104: 00010000:00010000:1.0:1789479904.912060:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479904.912083:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789479904.912088:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:5824:x1876405551904896:12345-0@lo:104: Request processed in 35us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.912092:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789479904.912731:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789479904.912740:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912748:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479904.912753:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912763:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479904.912771:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479904.912790:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479904.912830:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912837:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479904.912869:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912876:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd334 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912893:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789479904.912897:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912903:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479904.912906:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912912:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479904.912919:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479904.912924:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479904.912951:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912958:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479904.912976:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912983:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d2600/0xbb972366037fd303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd30a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.912992:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789479904.912995:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913002:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7139200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479904.913004:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913011:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479904.913018:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479904.913023:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479904.913037:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913042:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479904.913047:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913053:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7139200/0xbb972366037fd2e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913063:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479904.913071:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913076:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7139400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479904.913079:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913086:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479904.913092:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479904.913097:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479904.913112:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913126:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479904.913133:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913139:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7139400/0xbb972366037fd2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2c4 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913148:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479904.913151:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913156:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479904.913159:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913175:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479904.913181:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479904.913186:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479904.913199:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913205:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479904.913209:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913216:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d2a00/0xbb972366037fd293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd29a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.913232:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479904.913233:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479904.913235:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479904.913250:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905408:0@lo:103: 00000100:00100000:3.0:1789479904.913335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479904.913576:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479904.914646:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551905152:0@lo:103: 00000100:00100000:2.0:1789479904.914704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479904.914747:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479904.914753:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551905280:0@lo:103: 00000100:00100000:2.0:1789479904.914775:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479904.914815:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905408 00000100:00100000:2.0:1789479904.914823:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905408 00010000:00010000:2.0:1789479904.914868:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 17 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.914892:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905152 00000100:00100000:2.0:1789479904.914895:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905152 00010000:00010000:2.0:1789479904.914909:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 18 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.914919:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905280 00000100:00100000:2.0:1789479904.914921:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905280 00010000:00010000:2.0:1789479904.914931:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 19 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.914960:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479904.914969:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551905408:12345-0@lo:103: 00010000:00010000:2.0:1789479904.914982:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479904.914988:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 19 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.914999:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 19 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.915019:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479904.915054:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551905408:12345-0@lo:103: Request processed in 86us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479904.915061:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479904.915078:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479904.915085:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+18:3298:x1876405551905152:12345-0@lo:103: 00010000:00010000:2.0:1789479904.915092:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479904.915097:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 18 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.915105:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 18 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.915115:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479904.915155:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+18:3298:x1876405551905152:12345-0@lo:103: Request processed in 71us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479904.915161:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479904.915173:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479904.915185:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551905280:12345-0@lo:103: 00010000:00010000:2.0:1789479904.915194:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479904.915198:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 17 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.915205:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 17 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.915215:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479904.915237:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551905280:12345-0@lo:103: Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479904.915242:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479904.915279:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551905280:0@lo:103: 00000100:00100000:2.0:1789479904.915314:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551905152:0@lo:103: 00000100:00100000:2.0:1789479904.915348:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904384:0@lo:104: 00010000:00010000:2.0:1789479904.915360:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd30a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd303 expref: 16 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.915372:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4994700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904512:0@lo:104: 00010000:00010000:2.0:1789479904.915398:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030400/0xbb972366037fd2ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd2e7 expref: 15 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.915408:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904640:0@lo:104: 00010000:00010000:2.0:1789479904.915419:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd2c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd2bd expref: 14 pid: 5823 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479904.915430:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904768:0@lo:104: 00000100:00100000:2.0:1789479904.915450:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4994e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1876405551904896:0@lo:104: 00010000:00010000:2.0:1789479904.915474:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479904.916727:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789479904.921093:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905024:0@lo:103: 00000100:00100000:2.0:1789479904.921201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479904.921265:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905536:0@lo:103: 00000100:00100000:2.0:1789479904.921307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479904.921350:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905408:0@lo:103: 00000100:00100000:3.0:1789479904.922502:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905024 00000100:00100000:3.0:1789479904.922515:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905024 00010000:00010000:3.0:1789479904.922566:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 14 pid: 5824 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479904.922620:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905536 00000100:00100000:3.0:1789479904.922624:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905536 00010000:00010000:3.0:1789479904.922654:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 15 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479904.922671:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479904.922679:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+15:3300:x1876405551905024:12345-0@lo:103: 00010000:00010000:3.0:1789479904.922692:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479904.922698:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 15 pid: 5824 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922711:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 15 pid: 5824 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922731:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd32d expref: 15 pid: 5824 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922746:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479904.922809:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+14:3300:x1876405551905024:12345-0@lo:103: Request processed in 130us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479904.922816:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479904.922832:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789479904.922838:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3300:x1876405551905536:12345-0@lo:103: 00010000:00010000:3.0:1789479904.922878:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479904.922884:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 13 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922893:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 13 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922903:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2147c00/0xbb972366037fd29a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd293 expref: 13 pid: 5825 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922925:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922934:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922952:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922960:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922966:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922973:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922979:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280031a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789479904.922983:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.922991:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.923003:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479904.923015:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479904.923040:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+12:3300:x1876405551905536:12345-0@lo:103: Request processed in 202us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479904.923055:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479904.924187:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905024:0@lo:103: 00000100:00100000:2.0:1789479904.924199:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551905536:0@lo:103: 00010000:00010000:2.0:1789479904.924235:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.924245:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479904.924252:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280031a00/0xbb972366037fd349 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789479904.924269:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789479905.040570:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+11:7631:x1876405551904256:12345-0@lo:253: Request processed in 186578us (188388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479905.040586:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789479905.040694:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551904256:0@lo:253: 10000000:01000000:1.0:1789479905.040720:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789479905.040723:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789479905.040725:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789479905.040727:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789479905.040728:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789479905.040730:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789479905.040746:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789479905.040747:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789479905.040749:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789479905.040750:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789479905.040752:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789479905.040771:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d22b9aa2800 from lustre-OST0001 10000000:01000000:1.0:1789479905.040795:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789479905.040798:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789479905.040806:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d229c723380 local copy 10000000:01000000:1.0:1789479905.040810:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789479905.040853:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.040865:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.040875:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.040898:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905664:0@lo:101: 00000100:00100000:1.0:1789479905.040937:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.040996:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db780 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.041253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905664 00000100:00100000:2.0:1789479905.041261:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905664 00000100:00100000:2.0:1789479905.041344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789479905.041355:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+11:7631:x1876405551905664:12345-0@lo:101: 00010000:00010000:2.0:1789479905.041369:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479905.041390:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2800/0xbb972366037fd357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd350 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.041415:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2800/0xbb972366037fd357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd350 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.041425:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd350 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.041435:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2800, rc 0) 00000100:00100000:2.0:1789479905.041472:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551905664:12345-0@lo:101: Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.041477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789479905.041597:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905664:0@lo:101: 00010000:00010000:1.0:1789479905.041610:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.041618:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.041794:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905792:0@lo:501: 00000100:00100000:1.0:1789479905.041906:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.041982:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db780 going to sleep for 11 seconds 00000100:00100000:3.0:1789479905.042082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905792 00000100:00100000:3.0:1789479905.042088:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905792 00000100:00100000:3.0:1789479905.042950:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789479905.042964:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551905792:12345-0@lo:501: 00000100:00100000:3.0:1789479905.043257:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551905792:12345-0@lo:501: Request processed in 297us (1351us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789479905.043264:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789479905.043369:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905792:0@lo:501: 10000000:01000000:1.0:1789479905.043405:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789479905.043441:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789479905.043450:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.043459:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.043465:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.043496:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789479905.043524:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d22b9aa2800 10000000:01000000:1.0:1789479905.043529:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789479905.043534:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789479905.043537:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789479905.043541:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789479905.043544:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789479905.043570:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.043579:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.043588:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.043602:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905920:0@lo:101: 00000100:00100000:1.0:1789479905.043644:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479905.043725:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479905.043733:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.043741:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789479905.043744:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.043752:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479905.043760:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479905.043766:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479905.043791:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.043797:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479905.043814:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.043820:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2147a00/0xbb972366037fd350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbb972366037fd357 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.043833:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479905.043835:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479905.043836:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479905.044058:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.044136:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551905920 00000100:00100000:2.0:1789479905.044150:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551905920 00000100:00100000:2.0:1789479905.044177:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479905.044184:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551905920:12345-0@lo:101: 00010000:00010000:2.0:1789479905.044193:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479905.044205:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd35e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.044226:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd35e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.044236:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd35e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.044244:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2a00, rc 0) 00000100:00100000:2.0:1789479905.044305:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551905920:12345-0@lo:101: Request processed in 120us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.044320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479905.044350:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551906048:0@lo:103: 00000100:00100000:2.0:1789479905.044435:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479905.044472:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906048 00000100:00100000:2.0:1789479905.044476:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906048 00000100:00100000:2.0:1789479905.044504:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479905.044509:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+13:3298:x1876405551906048:12345-0@lo:103: 00010000:00010000:2.0:1789479905.044517:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479905.044529:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd350 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.044538:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479905.044562:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+12:3298:x1876405551906048:12345-0@lo:103: Request processed in 53us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.044567:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479905.044592:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551906048:0@lo:103: 00000100:00100000:1.0:1789479905.044657:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551905920:0@lo:101: 00010000:00010000:1.0:1789479905.044669:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.044678:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.044835:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906176:0@lo:501: 00000100:00100000:1.0:1789479905.044866:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.044892:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.045297:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906176 00000100:00100000:2.0:1789479905.045302:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906176 00000100:00100000:2.0:1789479905.045322:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789479905.045328:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906176:12345-0@lo:501: 00000100:00100000:2.0:1789479905.045574:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906176:12345-0@lo:501: Request processed in 245us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.045580:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789479905.045653:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906176:0@lo:501: 00000100:00100000:1.0:1789479905.045681:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906304:0@lo:503: 00000100:00100000:1.0:1789479905.045728:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.045756:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.045856:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906304 00000100:00100000:2.0:1789479905.045861:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906304 00000100:00100000:2.0:1789479905.045877:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789479905.045882:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906304:12345-0@lo:503: 00000100:00100000:2.0:1789479905.046045:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906304:12345-0@lo:503: Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.046052:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789479905.046205:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906304:0@lo:503: 00000040:00080000:1.0:1789479905.046534:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789479905.046606:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906432:0@lo:502: 00000100:00100000:1.0:1789479905.046647:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.046675:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.046847:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906432 00000100:00100000:2.0:1789479905.046851:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906432 00000100:00100000:2.0:1789479905.046887:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479905.046894:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906432:12345-0@lo:502: 00000100:00100000:2.0:1789479905.047048:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906432:12345-0@lo:502: Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.047055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789479905.047179:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906432:0@lo:502: 00000040:00080000:1.0:1789479905.047458:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789479905.047503:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789479905.047531:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789479905.047570:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789479905.047614:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789479905.047648:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789479905.047671:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906560:0@lo:502: 00000100:00100000:1.0:1789479905.047827:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.047893:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479905.047953:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906560 00000100:00100000:0.0:1789479905.047961:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906560 00000100:00100000:2.0:1789479905.048008:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789479905.048016:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906560:12345-0@lo:502: 00000100:00100000:2.0:1789479905.048172:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906560:12345-0@lo:502: Request processed in 157us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.048179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789479905.048250:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906560:0@lo:502: 00000040:00080000:1.0:1789479905.048360:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789479905.048369:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789479905.049092:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789479905.049101:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789479905.049108:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479905.049111:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789479905.049134:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789479905.049152:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d22a4ac99c0) 00000020:00000080:3.0:1789479905.049182:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789479905.049189:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789479905.049260:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22b9aa2800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789479905.049268:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789479905.049277:0:7638:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fd373 00010000:00010000:3.0:1789479905.053540:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789479905.054040:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789479905.057603:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789479905.058519:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789479905.077648:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789479905.089682:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789479905.099172:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789479905.099194:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479905.099206:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479905.099223:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789479905.099228:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479905.099233:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479905.099234:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789479905.099238:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789479905.099240:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789479905.099336:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479905.099340:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479905.099342:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789479905.099347:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789479905.099831:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789479905.100211:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789479905.100240:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.100254:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479905.100264:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22b9aa2800 from 1 10000000:01000000:1.0:1789479905.100267:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789479905.100334:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.100343:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.100355:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.100383:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906688:0@lo:101: 00000100:00100000:1.0:1789479905.100466:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.100540:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.100638:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906688 00000100:00100000:2.0:1789479905.100649:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906688 00000100:00100000:2.0:1789479905.100718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789479905.100728:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+12:7631:x1876405551906688:12345-0@lo:101: 00010000:00010000:2.0:1789479905.100742:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479905.100755:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd37a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.100780:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd37a expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.100792:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd37a expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.100808:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2800, rc 0) 00000100:00100000:2.0:1789479905.100868:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551906688:12345-0@lo:101: Request processed in 141us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.100875:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789479905.101478:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906688:0@lo:101: 00010000:00010000:1.0:1789479905.101497:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479905.101508:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479905.101623:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906816:0@lo:501: 00000100:00100000:1.0:1789479905.101660:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479905.101678:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.102437:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906816 00000100:00100000:2.0:1789479905.102444:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906816 00000100:00100000:2.0:1789479905.102485:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789479905.102492:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551906816:12345-0@lo:501: 00000100:00100000:2.0:1789479905.102948:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551906816:12345-0@lo:501: Request processed in 454us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.102956:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789479905.104429:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906816:0@lo:501: 00000100:00100000:0.0:1789479905.104492:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906944:0@lo:503: 00000100:00100000:0.0:1789479905.104563:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479905.104836:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479905.108482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551906944 00000100:00100000:3.0:1789479905.108503:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551906944 00000100:00100000:2.0:1789479905.111379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789479905.111394:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551906944:12345-0@lo:503: 00000100:00100000:2.0:1789479905.112267:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551906944:12345-0@lo:503: Request processed in 874us (7701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.112278:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789479905.113809:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551906944:0@lo:503: 00000040:00080000:0.0:1789479905.114257:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479905.115013:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907072:0@lo:502: 00000100:00100000:0.0:1789479905.115104:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479905.115224:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789479905.119557:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907072 00000100:00100000:1.0:1789479905.119571:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907072 00000100:00100000:1.0:1789479905.119688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789479905.119709:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551907072:12345-0@lo:502: 00000100:00100000:1.0:1789479905.120054:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551907072:12345-0@lo:502: Request processed in 348us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479905.120063:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789479905.120274:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907072:0@lo:502: 00000040:00080000:3.0:1789479905.120643:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789479905.120722:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789479905.120765:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907200:0@lo:502: 00000100:00100000:3.0:1789479905.120821:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.125781:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789479905.125956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907200 00000100:00100000:0.0:1789479905.125968:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907200 00000100:00100000:0.0:1789479905.126033:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789479905.126045:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551907200:12345-0@lo:502: 00000100:00100000:0.0:1789479905.126381:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551907200:12345-0@lo:502: Request processed in 337us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.126390:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789479905.126650:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907200:0@lo:502: 00000040:00080000:3.0:1789479905.126908:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789479905.126929:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789479905.129030:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479905.129046:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479905.129048:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789479905.129056:0:7642:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22b9aa2800 00000020:00000080:0.0:1789479905.129059:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789479905.129080:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479905.129083:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479905.129084:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789479905.129087:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789479905.129249:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789479905.129273:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479905.129314:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.129327:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479905.129373:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789479905.129387:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d22b9aa2800 10000000:01000000:3.0:1789479905.129390:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d22b9aa2800 10000000:01000000:3.0:1789479905.129393:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479905.129399:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22b9aa2800 from 1 10000000:01000000:3.0:1789479905.129401:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479905.129435:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.129443:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.129454:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479905.129475:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907328:0@lo:101: 00000100:00100000:3.0:1789479905.129545:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.129581:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.129636:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907328 00000100:00100000:2.0:1789479905.129642:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907328 00000100:00100000:2.0:1789479905.129682:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789479905.129690:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551907328:12345-0@lo:101: 00010000:00010000:2.0:1789479905.129772:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479905.129787:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd388 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.129810:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd388 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.129834:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd388 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.129843:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2600, rc 0) 00000100:00100000:2.0:1789479905.129888:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907328:12345-0@lo:101: Request processed in 198us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.129895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789479905.129945:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907328:0@lo:101: 00010000:00010000:2.0:1789479905.129961:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479905.129970:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479905.130046:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907456:0@lo:501: 00000100:00100000:2.0:1789479905.130068:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479905.130081:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.130092:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907456 00000100:00100000:2.0:1789479905.130095:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907456 00000100:00100000:2.0:1789479905.130112:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789479905.130129:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907456:12345-0@lo:501: 00000100:00100000:2.0:1789479905.130339:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907456:12345-0@lo:501: Request processed in 210us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.130346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789479905.130372:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907456:0@lo:501: 00000100:00100000:2.0:1789479905.130394:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907584:0@lo:503: 00000100:00100000:2.0:1789479905.130427:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479905.130438:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.130448:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907584 00000100:00100000:2.0:1789479905.130451:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907584 00000100:00100000:2.0:1789479905.130466:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789479905.130471:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907584:12345-0@lo:503: 00000100:00100000:2.0:1789479905.130593:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907584:12345-0@lo:503: Request processed in 121us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.130600:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789479905.130631:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907584:0@lo:503: 00000040:00080000:2.0:1789479905.131571:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789479905.131640:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907712:0@lo:502: 00000100:00100000:2.0:1789479905.131691:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479905.131844:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789479905.131882:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907712 00000100:00100000:0.0:1789479905.131887:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907712 00000100:00100000:0.0:1789479905.131955:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789479905.131965:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907712:12345-0@lo:502: 00000100:00100000:0.0:1789479905.132186:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907712:12345-0@lo:502: Request processed in 223us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.132194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789479905.132271:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907712:0@lo:502: 00000040:00080000:3.0:1789479905.132596:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789479905.132653:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789479905.132689:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789479905.132757:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789479905.132798:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789479905.132850:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789479905.132904:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789479905.132942:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789479905.133004:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789479905.133047:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789479905.133084:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789479905.133163:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789479905.133204:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789479905.133251:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789479905.133329:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789479905.133369:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789479905.133405:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789479905.133455:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789479905.133492:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789479905.133527:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789479905.133579:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789479905.133617:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789479905.133673:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789479905.133726:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789479905.133767:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789479905.133804:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789479905.133855:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789479905.133893:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789479905.133931:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789479905.133996:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789479905.134035:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789479905.134072:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789479905.134108:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789479905.134178:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789479905.134218:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789479905.134269:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789479905.134348:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789479905.134395:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907840:0@lo:502: 00000100:00100000:3.0:1789479905.134476:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.135408:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.135657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907840 00000100:00100000:2.0:1789479905.135665:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907840 00000100:00100000:2.0:1789479905.135796:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789479905.135806:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907840:12345-0@lo:502: 00000100:00100000:2.0:1789479905.136154:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551907840:12345-0@lo:502: Request processed in 349us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.136163:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789479905.137966:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551907840:0@lo:502: 00000040:00080000:3.0:1789479905.138130:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789479905.138148:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789479905.140320:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789479905.140346:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d22a4acb380) 00000020:00000080:3.0:1789479905.140372:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789479905.140452:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22b9aa2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789479905.140456:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22b9aa2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789479905.140459:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22b9aa2800 3 00010000:00080000:3.0:1789479905.140491:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d229c50f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789479905.146946:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789479905.148923:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789479905.148993:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789479905.150485:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb972366037fd39d 00000100:00080000:3.0:1789479905.150504:0:7643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789479905.150520:0:7643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d229c50f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789479905.150571:0:7643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a452fb80 x1876405551907968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789479905.150606:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789479905.150708:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551907968:0@lo:38: 00000100:00100000:1.0:1789479905.150798:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.150985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551907968 00000100:00100000:3.0:1789479905.150993:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551907968 00000100:00100000:3.0:1789479905.151033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479905.151040:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876405551907968:12345-0@lo:38: 00010000:00080000:3.0:1789479905.151067:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1789479905.151105:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb972366037fd3a4 00000004:00100000:3.0:1789479905.151132:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789479905.151166:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8d2186b39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479905.151219:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876405551907968:12345-0@lo:38: Request processed in 178us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479905.151226:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479905.151509:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551908352:0@lo:400: 00000100:00100000:3.0:1789479905.151566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479905.155005:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551908096:0@lo:400: 00000100:00100000:2.0:1789479905.155088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789479905.155870:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a452fb80 x1876405551907968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479905.155885:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789479905.155895:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789479905.155906:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789479905.155913:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789479905.155917:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479905.155938:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551907968:0@lo:38: 00000100:00100000:3.0:1789479905.157316:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479905.157333:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551908224:0@lo:400: 00000100:00100000:3.0:1789479905.157423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.157483:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908352 00000100:00100000:3.0:1789479905.157491:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908352 00000100:00100000:3.0:1789479905.157559:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479905.157568:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551908352:12345-0@lo:400: 00000100:00100000:3.0:1789479905.157627:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551908352:12345-0@lo:400: Request processed in 59us (6060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479905.157633:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789479905.157675:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a452dc00 x1876405551908352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479905.157688:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551908352:0@lo:400: 00000040:00080000:1.0:1789479905.158135:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789479905.158452:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908096 00000100:00100000:0.0:1789479905.158459:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908096 00000100:00100000:0.0:1789479905.158488:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908224 00000100:00100000:0.0:1789479905.158490:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908224 00000100:00100000:0.0:1789479905.158506:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479905.158513:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551908096:12345-0@lo:400: 00000100:00100000:0.0:1789479905.158619:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551908096:12345-0@lo:400: Request processed in 106us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.158625:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479905.158637:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479905.158654:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551908224:12345-0@lo:400: 00000100:00100000:0.0:1789479905.158685:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551908224:12345-0@lo:400: Request processed in 33us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.158690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479905.158956:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876405551908480:0@lo:901: 00000100:00100000:3.0:1789479905.158995:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.159025:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6c8d80 going to sleep for 11 seconds 00010000:00080000:1.0:1789479905.159090:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a452ca80 x1876405551908224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479905.159104:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551908224:0@lo:400: 00000100:00100000:0.0:1789479905.159172:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908480 00000100:00100000:0.0:1789479905.159177:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908480 00000100:00100000:0.0:1789479905.159213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479905.159219:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876405551908480:12345-0@lo:901: 00000100:00100000:0.0:1789479905.159628:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876405551908480:12345-0@lo:901: Request processed in 408us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.159635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789479905.159720:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a452dc00 x1876405551908480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789479921 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479905.159730:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876405551908480:0@lo:901: 00000100:00080000:0.0:1789479905.162276:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479905.162309:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1789479905.162335:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789479905.162377:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479905.162406:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.162419:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789479905.162478:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789479905.162480:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789479905.162482:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479905.162483:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479905.162484:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479905.162485:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479905.162487:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479905.162488:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479905.162490:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479905.162492:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479905.162499:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479905.162502:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789479905.162504:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789479905.162506:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789479905.162506:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479905.162507:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479905.162508:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479905.162509:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479905.162510:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479905.162511:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479905.162512:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479905.162513:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479905.162514:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479905.162545:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789479905.162565:0:7631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551908608:0@lo:253: 00000100:00100000:0.0:1789479905.162659:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479905.164842:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479905.165077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908608 00000100:00100000:2.0:1789479905.165087:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908608 00000100:00100000:2.0:1789479905.165159:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789479905.165170:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:7631:x1876405551908608:12345-0@lo:253: 20000000:01000000:2.0:1789479905.165212:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789479905.165227:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789479905.166963:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22a452e300 x1876405551908096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479905.166982:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551908096:0@lo:400: 20000000:01000000:2.0:1789479905.223762:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789479905.223780:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789479905.223864:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789479905.223869:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789479905.223893:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.223914:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.223924:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.223986:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479905.224006:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 14 pid: 5824 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479905.224022:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551908736:0@lo:104: 00000100:00100000:3.0:1789479905.224093:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479905.224155:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4423c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479905.224323:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908736 00000100:00100000:0.0:1789479905.224333:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908736 00000100:00100000:0.0:1789479905.224395:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479905.224405:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551908736:12345-0@lo:104: 00010000:00010000:0.0:1789479905.224419:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224475:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479905.224481:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:5846:x1876405551908736:12345-0@lo:104: Request processed in 78us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.224488:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479905.224528:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876405551908736:0@lo:104: 00010000:00010000:0.0:1789479905.224546:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224563:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479905.224578:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224585:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789479905.224589:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224598:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479905.224606:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479905.224612:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479905.224642:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224649:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479905.224666:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224673:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd2f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2fc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.224689:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479905.224690:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479905.224692:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479905.224712:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551908864:0@lo:103: 00000100:00100000:0.0:1789479905.224744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479905.224902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908864 00000100:00100000:0.0:1789479905.224907:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908864 00010000:00010000:0.0:1789479905.224931:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 15 pid: 5824 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479905.225000:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479905.225007:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+15:3298:x1876405551908864:12345-0@lo:103: 00010000:00010000:0.0:1789479905.225019:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479905.225024:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 15 pid: 5824 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225034:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 15 pid: 5824 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225048:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22b7138200/0xbb972366037fd2fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd2f5 expref: 15 pid: 5824 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225060:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225068:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789479905.225080:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001589272s 00010000:00010000:0.0:1789479905.225084:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225091:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225097:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225103:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225126:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789479905.225131:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225138:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225152:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.225162:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479905.225193:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+14:3298:x1876405551908864:12345-0@lo:103: Request processed in 187us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479905.225200:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789479905.226999:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.227014:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479905.227021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4600/0xbb972366037fd3ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479905.227079:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551908864:0@lo:103: 00000100:00100000:2.0:1789479905.235256:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:7631:x1876405551908608:12345-0@lo:253: Request processed in 70075us (72585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479905.235272:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789479905.235415:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e677fecc-98d9-457e-99be-c06439303d19:7631:1876405551908608:0@lo:253: 10000000:01000000:0.0:1789479905.235433:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789479905.235437:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479905.235438:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789479905.235455:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479905.235457:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479905.235458:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479905.235459:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479905.235461:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479905.235463:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479905.235464:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479905.235467:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479905.235468:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479905.235488:0:7631:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789479905.244044:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789479905.244274:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789479905.244527:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789479905.244753:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789479905.245189:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789479905.246022:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789479905.247144:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789479905.306434:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789479905.461094:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789479905.461104:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789479905.461155:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789479905.461239:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789479905.461256:0:7631:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789479905.461326:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1789479906.141491:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551908992:0@lo:13: 00000100:00100000:0.0:1789479906.141585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479906.141717:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551908992 00000100:00100000:2.0:1789479906.141726:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551908992 00000100:00100000:2.0:1789479906.141786:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479906.141796:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551908992:12345-0@lo:13: 00002000:00000024:2.0:1789479906.141839:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479906.141894:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551908992:12345-0@lo:13: Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479906.141902:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789479906.142045:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ae300 x1876405551908992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479906.142067:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551908992:0@lo:13: 00010000:00010000:0.0:1789479906.331411:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479907.356479:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479908.379454:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479909.402898:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479910.237665:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551909120:0@lo:400: 00000100:00100000:1.0:1789479910.237751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479910.237806:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551909632:0@lo:400: 00000100:00100000:1.0:1789479910.237835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479910.237863:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479910.237868:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551909248:0@lo:400: 00000100:00100000:1.0:1789479910.237886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479910.237915:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551909376:0@lo:400: 00000100:00100000:1.0:1789479910.237937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479910.237953:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479910.237958:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551909504:0@lo:400: 00000100:00100000:1.0:1789479910.237978:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479910.238005:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909120 00000100:00100000:1.0:1789479910.238013:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909120 00000100:00100000:1.0:1789479910.238071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789479910.238079:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:3300:x1876405551909120:12345-0@lo:400: 00000100:00100000:1.0:1789479910.238137:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:3300:x1876405551909120:12345-0@lo:400: Request processed in 58us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479910.238151:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789479910.238189:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909632 00000100:00100000:1.0:1789479910.238193:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909632 00000100:00100000:1.0:1789479910.238226:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909248 00000100:00100000:1.0:1789479910.238229:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909248 00000100:00100000:1.0:1789479910.238239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909376 00000100:00100000:1.0:1789479910.238241:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909376 00000100:00100000:1.0:1789479910.238256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479910.238261:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551909632:12345-0@lo:400: 00000100:00100000:1.0:1789479910.238316:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551909632:12345-0@lo:400: Request processed in 54us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479910.238322:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479910.238334:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789479910.238339:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551909248:12345-0@lo:400: 00000100:00100000:1.0:1789479910.238366:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551909248:12345-0@lo:400: Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479910.238371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789479910.238382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789479910.238388:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551909376:12345-0@lo:400: 00000100:00100000:1.0:1789479910.238418:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551909376:12345-0@lo:400: Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479910.238423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789479910.238452:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909504 00000100:00100000:1.0:1789479910.238455:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909504 00000100:00100000:1.0:1789479910.238483:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789479910.238490:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551909504:12345-0@lo:400: 00000100:00100000:1.0:1789479910.238520:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551909504:12345-0@lo:400: Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479910.238532:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789479910.238554:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789479910.238559:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789479910.238587:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48de300 x1876405551909504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479910.238602:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551909504:0@lo:400: 00010000:00080000:1.0:1789479910.238612:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48dca80 x1876405551909376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479910.238620:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551909376:0@lo:400: 00010000:00080000:1.0:1789479910.238651:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7f800 x1876405551909248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479910.238659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551909248:0@lo:400: 00000100:00100000:1.0:1789479910.238667:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551909120:0@lo:400: 00010000:00080000:1.0:1789479910.238675:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48dfb80 x1876405551909632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479910.238684:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551909632:0@lo:400: 00010000:00010000:1.0:1789479910.427895:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479911.277402:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479911.277445:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551909760:0@lo:13: 00000100:00100000:3.0:1789479911.277527:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479911.277772:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909760 00000100:00100000:3.0:1789479911.277781:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909760 00000100:00100000:3.0:1789479911.277832:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479911.277841:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551909760:12345-0@lo:13: 00002000:00000024:3.0:1789479911.277881:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479911.277935:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551909760:12345-0@lo:13: Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479911.277942:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789479911.277985:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ac700 x1876405551909760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479911.278034:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551909760:0@lo:13: 00010000:00010000:1.0:1789479911.452070:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479912.474549:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789479913.044612:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789479913.499567:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479914.523385:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789479915.355144:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789479915.355155:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22a4535800 from 30 10000000:01000000:1.0:1789479915.355162:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789479915.355243:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.355256:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.355269:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.355316:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551909888:0@lo:101: 00000100:00100000:1.0:1789479915.355397:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.355576:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551910144:0@lo:400: 00000100:00100000:0.0:1789479915.355619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.358882:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c42b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.358938:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551910016:0@lo:400: 00000100:00100000:1.0:1789479915.359022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.359092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910144 00000100:00100000:1.0:1789479915.359101:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910144 00000100:00100000:3.0:1789479915.359147:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551909888 00000100:00100000:3.0:1789479915.359152:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551909888 00000100:00100000:1.0:1789479915.359154:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910016 00000100:00100000:1.0:1789479915.359157:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910016 00000100:00100000:1.0:1789479915.359171:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789479915.359179:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551910144:12345-0@lo:400: 00000100:00100000:3.0:1789479915.359180:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789479915.359186:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551909888:12345-0@lo:101: 00000100:00100000:1.0:1789479915.359246:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551910144:12345-0@lo:400: Request processed in 67us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.359253:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789479915.359269:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479915.359276:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551910016:12345-0@lo:400: 00010000:00010000:3.0:1789479915.359303:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789479915.359320:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551910016:12345-0@lo:400: Request processed in 45us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1789479915.359322:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd3b2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.359326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789479915.359347:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.359358:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789479915.359360:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789479915.359368:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4a00, rc 0) 00010000:00080000:1.0:1789479915.359394:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4997480 x1876405551910016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.359399:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551909888:12345-0@lo:101: Request processed in 213us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.359405:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789479915.359409:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551910016:0@lo:400: 00000100:00100000:1.0:1789479915.359433:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551909888:0@lo:101: 00000100:00100000:3.0:1789479915.359435:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551910272:0@lo:400: 00010000:00010000:1.0:1789479915.359449:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.359460:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.359530:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551910528:0@lo:501: 00000100:00100000:2.0:1789479915.359669:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551910400:0@lo:400: 00000100:00100000:1.0:1789479915.359959:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.359962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.360008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.360046:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910272 00000100:00100000:2.0:1789479915.360050:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910272 00000100:00100000:2.0:1789479915.360104:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479915.360112:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551910272:12345-0@lo:400: 00000100:00100000:2.0:1789479915.360148:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551910272:12345-0@lo:400: Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.360165:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479915.360464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910528 00000100:00100000:1.0:1789479915.360464:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c42b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.360469:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910528 00000100:00080000:1.0:1789479915.360487:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479915.360619:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789479915.360625:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551910528:12345-0@lo:501: 00000100:00100000:2.0:1789479915.361145:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551910528:12345-0@lo:501: Request processed in 519us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.361153:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789479915.361184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910400 00000100:00100000:2.0:1789479915.361188:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910400 00000100:00100000:2.0:1789479915.361809:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479915.361892:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551910400:12345-0@lo:400: 00000100:00100000:2.0:1789479915.361954:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551910400:12345-0@lo:400: Request processed in 138us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.361961:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789479915.362000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4997b80 x1876405551910400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.362014:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551910400:0@lo:400: 00000100:00080000:1.0:1789479915.362122:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479915.362147:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551910528:0@lo:501: 00000100:00100000:1.0:1789479915.362190:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551910656:0@lo:503: 00010000:00080000:3.0:1789479915.362342:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4994700 x1876405551910272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.362353:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551910272:0@lo:400: 00010000:00080000:0.0:1789479915.369274:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4996a00 x1876405551910144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.369334:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551910144:0@lo:400: 00000100:00100000:1.0:1789479915.372924:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.372985:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c42b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.373562:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910656 00000100:00100000:0.0:1789479915.373571:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910656 00000100:00100000:0.0:1789479915.373640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789479915.373650:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551910656:12345-0@lo:503: 00000100:00100000:0.0:1789479915.374074:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551910656:12345-0@lo:503: Request processed in 424us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.374082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789479915.374147:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551910656:0@lo:503: 00000100:00100000:0.0:1789479915.374444:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8090:1876405551910784:0@lo:502: 00000100:00100000:0.0:1789479915.374484:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.374510:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.374985:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910784 00000100:00100000:2.0:1789479915.374992:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910784 00000100:00100000:2.0:1789479915.375034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789479915.375043:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8090:x1876405551910784:12345-0@lo:502: 00000100:00100000:2.0:1789479915.375341:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8090:x1876405551910784:12345-0@lo:502: Request processed in 298us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.375349:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789479915.376158:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8090:1876405551910784:0@lo:502: 00000100:00100000:0.0:1789479915.376231:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8090:1876405551910912:0@lo:502: 00000100:00100000:0.0:1789479915.378102:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.378192:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.378317:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551910912 00000100:00100000:3.0:1789479915.378326:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551910912 00000100:00100000:3.0:1789479915.378401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789479915.378412:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8090:x1876405551910912:12345-0@lo:502: 00000100:00100000:3.0:1789479915.378717:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8090:x1876405551910912:12345-0@lo:502: Request processed in 307us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.378734:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789479915.379023:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8090:1876405551910912:0@lo:502: 00000040:00080000:1.0:1789479915.379063:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789479915.380236:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789479915.380267:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789479915.380308:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.380322:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479915.380334:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789479915.380337:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789479915.380340:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789479915.380385:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.380395:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.380407:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479915.380435:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911040:0@lo:101: 00000100:00100000:3.0:1789479915.380515:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.380557:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925456c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.380749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911040 00000100:00100000:0.0:1789479915.380757:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911040 00000100:00100000:0.0:1789479915.380806:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789479915.380815:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551911040:12345-0@lo:101: 00010000:00010000:0.0:1789479915.380829:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.380842:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd3c0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.380866:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.380891:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.380899:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280030000, rc 0) 00000100:00100000:0.0:1789479915.380962:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911040:12345-0@lo:101: Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.380969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789479915.381165:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911040:0@lo:101: 00010000:00010000:2.0:1789479915.381187:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.381196:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.381251:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911168:0@lo:501: 00000100:00100000:2.0:1789479915.381304:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.381327:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.381432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911168 00000100:00100000:0.0:1789479915.381437:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911168 00000100:00100000:0.0:1789479915.381453:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789479915.381459:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911168:12345-0@lo:501: 00000100:00100000:0.0:1789479915.382095:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911168:12345-0@lo:501: Request processed in 634us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.382103:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789479915.385951:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911168:0@lo:501: 00000100:00100000:3.0:1789479915.387750:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911296:0@lo:503: 00000100:00100000:3.0:1789479915.387952:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.388002:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.388007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911296 00000100:00100000:2.0:1789479915.388015:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911296 00000100:00100000:2.0:1789479915.388078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789479915.388087:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911296:12345-0@lo:503: 00000100:00100000:2.0:1789479915.388864:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911296:12345-0@lo:503: Request processed in 776us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.388873:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789479915.389109:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911296:0@lo:503: 00000100:00100000:3.0:1789479915.389804:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8091:1876405551911424:0@lo:502: 00000100:00100000:3.0:1789479915.389859:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.389943:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.396387:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911424 00000100:00100000:1.0:1789479915.396405:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911424 00000100:00100000:1.0:1789479915.396485:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789479915.396506:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:8091:x1876405551911424:12345-0@lo:502: 00000100:00100000:1.0:1789479915.396928:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:8091:x1876405551911424:12345-0@lo:502: Request processed in 421us (7056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.396937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789479915.397508:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8091:1876405551911424:0@lo:502: 00000020:01000000:3.0:1789479915.397549:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479915.397561:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479915.397564:0:8091:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789479915.397570:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789479915.397572:0:8091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789479915.397604:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8091:1876405551911552:0@lo:502: 00000100:00100000:3.0:1789479915.397673:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.397732:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.397950:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911552 00000100:00100000:0.0:1789479915.397958:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911552 00000100:00100000:0.0:1789479915.398019:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789479915.398030:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:8091:x1876405551911552:12345-0@lo:502: 00000100:00100000:0.0:1789479915.398241:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:8091:x1876405551911552:12345-0@lo:502: Request processed in 212us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.398249:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789479915.398642:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8091:1876405551911552:0@lo:502: 00000020:01000000:3.0:1789479915.398674:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479915.398679:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479915.398681:0:8091:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789479915.398686:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789479915.400067:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789479915.400104:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789479915.400115:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.400128:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.400152:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789479915.400155:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22aea50800 from 30 10000000:01000000:0.0:1789479915.400157:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479915.400204:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.400215:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.400226:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.400247:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911680:0@lo:101: 00000100:00100000:0.0:1789479915.400340:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.400383:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.401092:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911680 00000100:00100000:3.0:1789479915.401101:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911680 00000100:00100000:3.0:1789479915.401158:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789479915.401167:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551911680:12345-0@lo:101: 00010000:00010000:3.0:1789479915.401185:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479915.401201:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd3ce expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.401242:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd3ce expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.401254:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3ce expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.401268:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5200, rc 0) 00000100:00100000:3.0:1789479915.401362:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551911680:12345-0@lo:101: Request processed in 196us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.401368:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789479915.401504:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911680:0@lo:101: 00010000:00010000:0.0:1789479915.401521:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.401531:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.401585:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911808:0@lo:501: 00000100:00100000:0.0:1789479915.401614:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.401640:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.401767:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911808 00000100:00100000:1.0:1789479915.401772:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911808 00000100:00100000:1.0:1789479915.401803:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789479915.401810:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551911808:12345-0@lo:501: 00000100:00100000:1.0:1789479915.402110:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551911808:12345-0@lo:501: Request processed in 299us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.402118:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789479915.404902:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911808:0@lo:501: 00000100:00100000:0.0:1789479915.404983:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911936:0@lo:503: 00000100:00100000:0.0:1789479915.405075:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.405163:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.413714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551911936 00000100:00100000:2.0:1789479915.413732:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551911936 00000100:00100000:2.0:1789479915.413800:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789479915.413810:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551911936:12345-0@lo:503: 00000100:00100000:2.0:1789479915.414146:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551911936:12345-0@lo:503: Request processed in 336us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.414155:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789479915.414420:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551911936:0@lo:503: 00000100:00100000:3.0:1789479915.415363:0:8092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8092:1876405551912064:0@lo:502: 00000100:00100000:3.0:1789479915.415430:0:8092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.415488:0:8092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.415622:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912064 00000100:00100000:2.0:1789479915.415629:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912064 00000100:00100000:2.0:1789479915.415668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789479915.415684:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:8092:x1876405551912064:12345-0@lo:502: 00000100:00100000:2.0:1789479915.415926:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:8092:x1876405551912064:12345-0@lo:502: Request processed in 231us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.415934:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789479915.416258:0:8092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8092:1876405551912064:0@lo:502: 00000100:00100000:3.0:1789479915.416340:0:8092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8092:1876405551912192:0@lo:502: 00000100:00100000:3.0:1789479915.416379:0:8092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.417126:0:8092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a44236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.417559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912192 00000100:00100000:0.0:1789479915.417569:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912192 00000100:00100000:0.0:1789479915.417622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789479915.417631:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8092:x1876405551912192:12345-0@lo:502: 00000100:00100000:0.0:1789479915.417888:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8092:x1876405551912192:12345-0@lo:502: Request processed in 258us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.417896:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789479915.418070:0:8092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8092:1876405551912192:0@lo:502: 00000040:00080000:3.0:1789479915.418106:0:8092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789479915.418359:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789479915.418377:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479915.418388:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.418400:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.418408:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789479915.418411:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d22aea50800 from 5 10000000:01000000:0.0:1789479915.418413:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789479915.418446:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.418454:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.418464:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.418794:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912320:0@lo:101: 00000100:00100000:0.0:1789479915.418839:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.418876:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.418951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912320 00000100:00100000:1.0:1789479915.418957:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912320 00000100:00100000:1.0:1789479915.419150:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789479915.419160:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551912320:12345-0@lo:101: 00010000:00010000:1.0:1789479915.419170:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479915.419187:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2146400/0xbb972366037fd3e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd3dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.419371:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2146400/0xbb972366037fd3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd3dc expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.419383:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2146400/0xbb972366037fd3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3dc expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.419392:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146400, rc 0) 00000100:00100000:1.0:1789479915.419434:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551912320:12345-0@lo:101: Request processed in 277us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.419440:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789479915.420332:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912320:0@lo:101: 00010000:00010000:0.0:1789479915.420353:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.420362:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.420423:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912448:0@lo:256: 00000100:00100000:0.0:1789479915.420477:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.420879:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.421055:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912448 00000100:00100000:2.0:1789479915.423326:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912448 00000100:00100000:2.0:1789479915.423418:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789479915.423429:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551912448:12345-0@lo:256: 20000000:01000000:2.0:1789479915.423460:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789479915.423486:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789479915.423490:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789479915.423645:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551912448:12345-0@lo:256: Request processed in 217us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.423653:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789479915.423857:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912448:0@lo:256: 10000000:01000000:0.0:1789479915.423931:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789479915.423941:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.423952:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.423961:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789479915.423964:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789479915.423967:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789479915.424001:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.424021:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.424031:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.424052:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912576:0@lo:101: 00000100:00100000:0.0:1789479915.424090:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.424121:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.424246:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912576 00000100:00100000:1.0:1789479915.424251:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912576 00000100:00100000:1.0:1789479915.424310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789479915.424318:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551912576:12345-0@lo:101: 00010000:00010000:1.0:1789479915.424328:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479915.424342:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd3ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.424365:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd3ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.424375:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.424384:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147200, rc 0) 00000100:00100000:1.0:1789479915.424418:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551912576:12345-0@lo:101: Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.424424:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789479915.425493:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912576:0@lo:101: 00010000:00010000:0.0:1789479915.425524:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.425535:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.425602:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912704:0@lo:501: 00000100:00100000:0.0:1789479915.425658:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.425695:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.426028:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912704 00000100:00100000:1.0:1789479915.426034:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912704 00000100:00100000:1.0:1789479915.426079:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789479915.426088:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551912704:12345-0@lo:501: 00000100:00100000:1.0:1789479915.426420:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551912704:12345-0@lo:501: Request processed in 333us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.426427:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789479915.426518:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912704:0@lo:501: 00000100:00100000:0.0:1789479915.426549:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912832:0@lo:503: 00000100:00100000:0.0:1789479915.426592:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.426616:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.427002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912832 00000100:00100000:1.0:1789479915.427007:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912832 00000100:00100000:1.0:1789479915.427041:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789479915.427048:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551912832:12345-0@lo:503: 00000100:00100000:1.0:1789479915.427400:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551912832:12345-0@lo:503: Request processed in 352us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.427408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789479915.427862:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551912832:0@lo:503: 00000100:00100000:0.0:1789479915.430087:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8093:1876405551912960:0@lo:502: 00000100:00100000:0.0:1789479915.430189:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.430255:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.430536:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551912960 00000100:00100000:1.0:1789479915.430544:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551912960 00000100:00100000:1.0:1789479915.430604:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789479915.430614:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8093:x1876405551912960:12345-0@lo:502: 00000100:00100000:1.0:1789479915.431959:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8093:x1876405551912960:12345-0@lo:502: Request processed in 1339us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.431971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789479915.432183:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8093:1876405551912960:0@lo:502: 00000020:01000000:0.0:1789479915.432231:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789479915.432240:0:8093:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789479915.432247:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479915.432250:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789479915.432255:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789479915.432260:0:8093:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1789479915.432306:0:8093:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789479915.432309:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789479915.432324:0:8093:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d22b99c4d40) 00000020:00000080:0.0:1789479915.432348:0:8093:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789479915.432355:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789479915.432442:0:8093:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789479915.432448:0:8093:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789479915.432472:0:8093:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fd3ff 00010000:00080000:0.0:1789479915.432503:0:8093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2283eae000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789479915.432928:0:8093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789479915.433273:0:8093:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789479915.433324:0:8093:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789479915.435144:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479915.435740:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479915.435793:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789479915.435857:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789479915.438094:0:8094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789479915.438103:0:8094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789479915.444173:0:8093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789479915.444188:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789479915.444225:0:8093:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789479915.444249:0:8093:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fd406 00000100:00080000:0.0:1789479915.444261:0:8093:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789479915.444310:0:8093:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2283eae000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789479915.444347:0:8093:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22a4995c00 x1876405551913088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789479915.444371:0:8093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789479915.444421:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479915.444425:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479915.444427:0:8093:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789479915.444429:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479915.444433:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479915.444435:0:8093:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789479915.444437:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789479915.444439:0:8093:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789479915.444466:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8093:1876405551913216:0@lo:502: 00000100:00100000:0.0:1789479915.444557:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.444592:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229292cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.444948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913216 00000100:00100000:2.0:1789479915.444955:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913216 00000100:00100000:2.0:1789479915.445011:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789479915.445020:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:8093:x1876405551913216:12345-0@lo:502: 00000100:00100000:2.0:1789479915.445268:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:8093:x1876405551913216:12345-0@lo:502: Request processed in 249us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.445276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789479915.445429:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8093:1876405551913216:0@lo:502: 00000020:01000000:0.0:1789479915.445453:0:8093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479915.445457:0:8093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479915.445459:0:8093:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789479915.445463:0:8093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1789479915.445825:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551913088:0@lo:8: 00000100:00100000:3.0:1789479915.445870:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789479915.445953:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789479915.445981:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789479915.445993:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.446005:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479915.446028:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789479915.446031:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d229c723380 from 1 10000000:01000000:2.0:1789479915.446034:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789479915.446060:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.446068:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.446077:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.446090:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551913344:0@lo:101: 00000100:00100000:2.0:1789479915.446115:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.446138:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.446423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913344 00000100:00100000:3.0:1789479915.446428:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913344 00000100:00100000:3.0:1789479915.446458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789479915.446472:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551913344:12345-0@lo:101: 00010000:00010000:3.0:1789479915.446484:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479915.446508:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd40d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.446533:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd40d expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.446543:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd40d expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.446551:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4000, rc 0) 00000100:00100000:3.0:1789479915.446585:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551913344:12345-0@lo:101: Request processed in 114us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.446591:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789479915.446925:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913088 00000100:00100000:0.0:1789479915.446930:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913088 00000100:00100000:0.0:1789479915.446962:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789479915.446970:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551913088:12345-0@lo:8: 00010000:00080000:0.0:1789479915.447002:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1789479915.447036:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fd41b 00002000:00100000:0.0:1789479915.447052:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2283ead000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789479915.447057:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789479915.447067:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789479915.447212:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789479915.447410:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789479915.447439:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d2283ea8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479915.447509:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405551913088:12345-0@lo:8: Request processed in 526us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.447516:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789479915.447564:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4995c00 x1876405551913088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.447576:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789479915.447583:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789479915.447592:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789479915.447598:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789479915.447613:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2283eae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789479915.447627:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789479915.448509:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551913344:0@lo:101: 00010000:00010000:2.0:1789479915.448534:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.448548:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.448827:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551913472:0@lo:501: 00000100:00100000:2.0:1789479915.448878:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.448941:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.449185:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551913088:0@lo:8: 00000004:00080000:0.0:1789479915.449229:0:8094:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789479915.449367:0:8094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208446083461ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789479915.449451:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913472 00000100:00100000:3.0:1789479915.449457:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913472 00000100:00100000:3.0:1789479915.449520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789479915.449529:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551913472:12345-0@lo:501: 00000100:00100000:3.0:1789479915.451302:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551913472:12345-0@lo:501: Request processed in 666us (1314us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789479915.451319:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789479915.451490:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551913472:0@lo:501: 10000000:01000000:2.0:1789479915.451538:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789479915.451560:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.451571:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789479915.504046:0:8095:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789479915.504084:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913728:0@lo:7: 00000100:00100000:2.0:1789479915.504167:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.504271:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479915.504299:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551913600:0@lo:13: 00000100:00100000:0.0:1789479915.504332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.504472:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913728 00000100:00100000:2.0:1789479915.504479:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913728 00000100:00100000:2.0:1789479915.504581:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479915.504590:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1876405551913728:12345-0@lo:7: 00000100:00100000:0.0:1789479915.506370:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913600 00000100:00100000:0.0:1789479915.506380:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913600 00000100:00100000:0.0:1789479915.506429:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479915.506438:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551913600:12345-0@lo:13: 00002000:00000024:0.0:1789479915.506462:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789479915.506551:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551913600:12345-0@lo:13: Request processed in 114us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.506568:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789479915.506593:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:0.0:1789479915.506665:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ae300 x1876405551913600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.506687:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551913600:0@lo:13: 00000100:00100000:3.0:1789479915.507648:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092a9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789479915.508395:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789479915.512862:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789479915.512874:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789479915.513156:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1876405551913728:12345-0@lo:7: Request processed in 8560us (8981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.513170:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789479915.513323:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48adf80 x1876405551913728/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.513340:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913728:0@lo:7: 00000004:00080000:3.0:1789479915.513357:0:8095:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789479915.513401:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913856:0@lo:5: 00000100:00100000:3.0:1789479915.513449:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.513595:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.513814:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913856 00000100:00100000:2.0:1789479915.513821:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913856 00000100:00100000:2.0:1789479915.513920:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479915.513931:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8095:x1876405551913856:12345-0@lo:5: 00002000:00080000:2.0:1789479915.513959:0:6686:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789479915.513964:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789479915.514273:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8095:x1876405551913856:12345-0@lo:5: Request processed in 343us (822us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789479915.514304:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789479915.514373:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452d500 x1876405551913856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.514387:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913856:0@lo:5: 00000004:00080000:3.0:1789479915.514398:0:8095:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789479915.514426:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913984:0@lo:700: 00000100:00100000:3.0:1789479915.514453:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.514482:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521180 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.514701:0:6817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551913984 00000100:00100000:1.0:1789479915.514706:0:6817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551913984 00000100:00100000:1.0:1789479915.514758:0:6817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479915.514766:0:6817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8095:x1876405551913984:12345-0@lo:700: 00000100:00100000:1.0:1789479915.514797:0:6817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6817:1876405551914112:0@lo:700: 00000100:00100000:1.0:1789479915.514830:0:6817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.514856:0:6817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2288b42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.514873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914112 00000100:00100000:1.0:1789479915.514877:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914112 00000100:00100000:1.0:1789479915.514902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479915.514908:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6817:x1876405551914112:12345-0@lo:700: 00010000:00010000:2.0:1789479915.554272:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789479915.594799:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789479915.607776:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6817:x1876405551914112:12345-0@lo:700: Request processed in 92854us (92931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.607796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789479915.612871:0:6817:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48de300 x1876405551914112/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.612896:0:6817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6817:1876405551914112:0@lo:700: 40000000:02000000:1.0:1789479915.613173:0:6817:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789479915.751214:0:6817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8095:x1876405551913984:12345-0@lo:700: Request processed in 236434us (236745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.751241:0:6817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789479915.751404:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452d880 x1876405551913984/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.751444:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551913984:0@lo:700: 00000001:00100000:3.0:1789479915.751774:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789479915.751792:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:2.0:1789479915.792270:0:8095:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789479915.797890:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551914240:0@lo:5: 00000100:00100000:3.0:1789479915.797996:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.798126:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521540 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.798221:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914240 00000100:00100000:2.0:1789479915.798231:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914240 00000100:00100000:2.0:1789479915.798393:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479915.798405:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8095:x1876405551914240:12345-0@lo:5: 00002000:00080000:3.0:1789479915.806425:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789479915.806459:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789479915.810348:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8095:x1876405551914240:12345-0@lo:5: Request processed in 11933us (12339us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789479915.810366:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789479915.811099:0:8095:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452dc00 x1876405551914240/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.811120:0:8095:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789479915.811144:0:8095:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d22a452dc00 x1876405551914240/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.811158:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876405551914240:0@lo:5: 00000004:00080000:1.0:1789479915.811190:0:8095:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789479916.397178:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551914368:0@lo:13: 00000100:00100000:0.0:1789479916.397307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479916.397417:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914368 00000100:00100000:0.0:1789479916.397427:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914368 00000100:00100000:0.0:1789479916.397482:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789479916.397493:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551914368:12345-0@lo:13: 00002000:00000024:0.0:1789479916.397538:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479916.397585:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551914368:12345-0@lo:13: Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479916.397592:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789479916.397634:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4996d80 x1876405551914368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479916.397655:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551914368:0@lo:13: 00010000:00010000:1.0:1789479916.571519:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479917.596434:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479918.619518:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789479919.121711:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789479919.651052:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479919.866677:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479919.867089:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526724736 00000100:00100000:3.0:1789479919.867102:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526724736 00000100:00100000:3.0:1789479919.867169:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:3.0:1789479919.867178:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2344:x1876405526724736:12345-192.168.204.54@tcp:250: 00010000:00080000:3.0:1789479919.867215:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0d717579-5363-42c9-a5a4-3c4ed264ebef@192.168.204.54@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1789479919.867249:0:5823:0:(genops.c:1384:class_connect()) connect: client 0d717579-5363-42c9-a5a4-3c4ed264ebef, cookie 0xbb972366037fd422 00000100:00080000:3.0:1789479919.867450:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8d21854f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479919.867530:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+5:2344:x1876405526724736:12345-192.168.204.54@tcp:250: Request processed in 351us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479919.867539:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:3.0:1789479919.871848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479919.873710:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526724864 00000100:00100000:0.0:1789479919.873725:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526724864 00000100:00100000:0.0:1789479919.873795:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1789479919.873807:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+5:5577:x1876405526724864:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1789479919.873843:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479919.873865:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f305f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479919.873898:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479919.873912:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479919.873922:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280031400, rc 0) 00000100:00100000:0.0:1789479919.873993:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+6:5577:x1876405526724864:12345-192.168.204.54@tcp:101: Request processed in 188us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479919.874006:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1789479919.879106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479919.879323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526724992 00000100:00100000:2.0:1789479919.879333:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526724992 00000100:00100000:2.0:1789479919.879392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:2.0:1789479919.879402:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+6:5577:x1876405526724992:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789479919.879770:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+6:5577:x1876405526724992:12345-192.168.204.54@tcp:501: Request processed in 368us (673us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789479919.879778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1789479919.883673:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479919.883756:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725120 00000100:00100000:1.0:1789479919.883766:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725120 00000100:00100000:1.0:1789479919.883822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:1.0:1789479919.883842:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+6:5577:x1876405526725120:12345-192.168.204.54@tcp:101: 00010000:00010000:1.0:1789479919.883859:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479919.883877:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3066 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479919.883918:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479919.883931:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479919.883941:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146c00, rc 0) 00000100:00100000:1.0:1789479919.884006:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+7:5577:x1876405526725120:12345-192.168.204.54@tcp:101: Request processed in 175us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479919.884027:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1789479919.886518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479919.886783:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725248 00000100:00100000:2.0:1789479919.886792:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725248 00000100:00100000:2.0:1789479919.886853:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:2.0:1789479919.886864:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+7:5577:x1876405526725248:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789479919.887149:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5577:x1876405526725248:12345-192.168.204.54@tcp:501: Request processed in 286us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479919.887156:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1789479919.903392:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479919.903443:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725376 00000100:00100000:2.0:1789479919.903454:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725376 00000100:00100000:2.0:1789479919.903518:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1789479919.903528:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5577:x1876405526725376:12345-192.168.204.54@tcp:503: 00000100:00100000:2.0:1789479919.903948:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5577:x1876405526725376:12345-192.168.204.54@tcp:503: Request processed in 419us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479919.903964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1789479919.913152:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479919.913243:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725504 00000100:00100000:3.0:1789479919.913255:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725504 00000100:00100000:3.0:1789479919.913331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789479919.913350:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5595:x1876405526725504:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1789479919.913867:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5595:x1876405526725504:12345-192.168.204.54@tcp:502: Request processed in 526us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479919.913876:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1789479919.972043:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479919.975724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725632 00000100:00100000:0.0:1789479919.975741:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725632 00000100:00100000:1.0:1789479919.978603:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789479919.978618:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5595:x1876405526725632:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1789479919.979740:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5595:x1876405526725632:12345-192.168.204.54@tcp:502: Request processed in 1117us (7700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479919.979752:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789479919.985991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479919.986100:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725760 00000100:00100000:2.0:1789479919.986111:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725760 00000100:00100000:2.0:1789479919.986214:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789479919.986226:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5577:x1876405526725760:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1789479919.986246:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479919.986266:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d3000/0xbb972366037fd437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3090 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479919.986348:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d3000/0xbb972366037fd437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3090 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479919.986361:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d3000/0xbb972366037fd437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3090 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479919.986371:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d3000, rc 0) 00000100:00100000:2.0:1789479919.986457:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5577:x1876405526725760:12345-192.168.204.54@tcp:101: Request processed in 232us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479919.986464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1789479919.998727:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479920.001137:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526725888 00000100:00100000:1.0:1789479920.001154:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526725888 00000100:00100000:1.0:1789479920.001233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1789479920.001244:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5577:x1876405526725888:12345-192.168.204.54@tcp:256: 20000000:01000000:1.0:1789479920.001271:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789479920.001314:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789479920.001318:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789479920.001321:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789479920.001324:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789479920.010156:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5577:x1876405526725888:12345-192.168.204.54@tcp:256: Request processed in 8899us (11428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.010172:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1789479920.014580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479920.014684:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726016 00000100:00100000:2.0:1789479920.014693:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726016 00000100:00100000:2.0:1789479920.014759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1789479920.014770:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5577:x1876405526726016:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1789479920.014788:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479920.014848:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3097 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.014884:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.015039:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.015049:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789479920.015158:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5577:x1876405526726016:12345-192.168.204.54@tcp:101: Request processed in 390us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.015165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1789479920.019145:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479920.019608:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726144 00000100:00100000:2.0:1789479920.019619:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726144 00000100:00100000:2.0:1789479920.019728:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:2.0:1789479920.019739:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5577:x1876405526726144:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789479920.020075:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5577:x1876405526726144:12345-192.168.204.54@tcp:501: Request processed in 337us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.020084:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1789479920.023086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479920.023186:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726272 00000100:00100000:0.0:1789479920.023198:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726272 00000100:00100000:0.0:1789479920.023679:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789479920.023691:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5577:x1876405526726272:12345-192.168.204.54@tcp:503: 00000100:00100000:0.0:1789479920.024125:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5577:x1876405526726272:12345-192.168.204.54@tcp:503: Request processed in 435us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.024134:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789479920.029051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479920.029172:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726400 00000100:00100000:2.0:1789479920.029183:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726400 00000100:00100000:2.0:1789479920.029597:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1789479920.029608:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5600:x1876405526726400:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1789479920.029954:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5600:x1876405526726400:12345-192.168.204.54@tcp:502: Request processed in 346us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.029963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1789479920.034740:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479920.034850:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726528 00000100:00100000:3.0:1789479920.034861:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726528 00000100:00100000:3.0:1789479920.034932:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:3.0:1789479920.034944:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5600:x1876405526726528:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1789479920.035274:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5600:x1876405526726528:12345-192.168.204.54@tcp:502: Request processed in 331us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479920.035311:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1789479920.041156:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479920.041262:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726656 00000100:00100000:1.0:1789479920.041274:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726656 00000100:00100000:1.0:1789479920.041367:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789479920.041375:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2344:x1876405526726656:12345-192.168.204.54@tcp:38: 00010000:00080000:1.0:1789479920.041410:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1789479920.041481:0:5830:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fd445 00000004:00100000:1.0:1789479920.041517:0:5830:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789479920.041535:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789479920.084687:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8d21854fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479920.084780:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526726656:12345-192.168.204.54@tcp:38: Request processed in 43402us (43636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479920.084811:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789479920.475197:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551914496:0@lo:400: 00000100:00100000:0.0:1789479920.475314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475376:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551915008:0@lo:400: 00000100:00100000:0.0:1789479920.475409:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475437:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789479920.475445:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551914624:0@lo:400: 00000100:00100000:0.0:1789479920.475467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475482:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551915136:0@lo:400: 00000100:00100000:0.0:1789479920.475508:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475535:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551914880:0@lo:400: 00000100:00100000:0.0:1789479920.475559:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475577:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479920.475582:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551914752:0@lo:400: 00000100:00100000:0.0:1789479920.475603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.475629:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915136 00000100:00100000:0.0:1789479920.475637:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915136 00000100:00100000:0.0:1789479920.475687:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914880 00000100:00100000:0.0:1789479920.475690:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914880 00000100:00100000:0.0:1789479920.475710:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479920.475719:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551915136:12345-0@lo:400: 00000100:00100000:0.0:1789479920.475772:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551915136:12345-0@lo:400: Request processed in 54us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.475788:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479920.475808:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789479920.475824:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551914880:12345-0@lo:400: 00000100:00100000:0.0:1789479920.475861:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551914880:12345-0@lo:400: Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.475867:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789479920.475882:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789479920.475887:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789479920.475914:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd90a80 x1876405551914880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479920.475926:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551914880:0@lo:400: 00010000:00080000:0.0:1789479920.475948:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd93b80 x1876405551915136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479920.475956:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789479920.475964:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551915136:0@lo:400: 00000100:00100000:2.0:1789479920.476354:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915008 00000100:00100000:2.0:1789479920.476369:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915008 00000100:00100000:2.0:1789479920.476410:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914624 00000100:00100000:2.0:1789479920.476414:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914624 00000100:00100000:2.0:1789479920.476428:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914752 00000100:00100000:2.0:1789479920.476431:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914752 00000100:00100000:2.0:1789479920.476446:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479920.476453:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551915008:12345-0@lo:400: 00000100:00100000:2.0:1789479920.476501:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551915008:12345-0@lo:400: Request processed in 49us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.476507:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479920.476520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789479920.476525:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551914624:12345-0@lo:400: 00000100:00100000:2.0:1789479920.476550:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551914624:12345-0@lo:400: Request processed in 24us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.476555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789479920.476564:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789479920.476569:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551914752:12345-0@lo:400: 00000100:00100000:2.0:1789479920.476597:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551914752:12345-0@lo:400: Request processed in 28us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.476602:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789479920.476639:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd91c00 x1876405551914752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.476649:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551914752:0@lo:400: 00010000:00080000:2.0:1789479920.476671:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452d880 x1876405551914624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.476679:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551914624:0@lo:400: 00010000:00080000:2.0:1789479920.476701:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd92300 x1876405551915008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.476710:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551915008:0@lo:400: 00000100:00100000:3.0:1789479920.476859:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551914496 00000100:00100000:3.0:1789479920.476864:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551914496 00000100:00100000:3.0:1789479920.476901:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789479920.476909:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551914496:12345-0@lo:400: 00000100:00100000:3.0:1789479920.476948:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551914496:12345-0@lo:400: Request processed in 40us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479920.476954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789479920.477090:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551914496:0@lo:400: 00000100:00080000:0.0:1789479920.477155:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789479920.666641:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479920.987753:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915264:0@lo:13: 00000100:00100000:0.0:1789479920.988147:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.993653:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915264 00000100:00100000:1.0:1789479920.993671:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915264 00000100:00100000:1.0:1789479920.993889:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479920.993901:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915264:12345-0@lo:13: 00002000:00000024:1.0:1789479920.993945:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479920.996071:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915264:12345-0@lo:13: Request processed in 2165us (7916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.996087:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789479920.997454:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48de300 x1876405551915264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479920.997480:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915264:0@lo:13: 00000100:00100000:0.0:1789479921.092593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479921.093026:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726784 00000100:00100000:2.0:1789479921.093037:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726784 00000100:00100000:2.0:1789479921.093130:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789479921.093141:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:0:x1876405526726784:12345-192.168.204.54@tcp:41: 00000004:00000024:2.0:1789479921.093193:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789479921.093319:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:0:x1876405526726784:12345-192.168.204.54@tcp:41: Request processed in 179us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.093327:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00080000:0.0:1789479921.093402:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479921.094802:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479921.094884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526726912 00000100:00100000:3.0:1789479921.094892:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526726912 00000100:00100000:3.0:1789479921.094944:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789479921.094953:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526726912:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1789479921.094977:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789479921.095042:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526726912:12345-192.168.204.54@tcp:41: Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479921.095051:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789479921.123755:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479921.123883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727040 00000100:00100000:2.0:1789479921.123895:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727040 00000100:00100000:2.0:1789479921.123963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789479921.123974:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526727040:12345-192.168.204.54@tcp:40: 00000100:00100000:2.0:1789479921.124083:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526727040:12345-192.168.204.54@tcp:40: Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.124091:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789479921.128714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479921.128776:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479921.128840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479921.128868:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727552 00000100:00100000:0.0:1789479921.128877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479921.128881:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727552 00000100:00100000:0.0:1789479921.128929:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727168 00000100:00100000:0.0:1789479921.128935:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727168 00000100:00100000:2.0:1789479921.128941:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:2.0:1789479921.128954:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2345:x1876405526727552:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1789479921.128967:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727296 00000100:00100000:0.0:1789479921.128971:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727296 00000100:00100000:0.0:1789479921.128988:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789479921.128996:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1876405526727168:12345-192.168.204.54@tcp:8: 00010000:00080000:0.0:1789479921.129025:0:6686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:2.0:1789479921.129033:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2345:x1876405526727552:12345-192.168.204.54@tcp:400: Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.129052:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000020:00000080:0.0:1789479921.129063:0:6686:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fd44c 00002000:00100000:0.0:1789479921.129079:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f712dbb2-3172-402a-b822-94513dd5b6e3/ffff8d2283eae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789479921.129107:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789479921.129228:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727424 00000100:00100000:1.0:1789479921.129233:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727424 00000100:00100000:1.0:1789479921.129275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789479921.129315:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526727424:12345-192.168.204.54@tcp:33: 00002000:00080000:0.0:1789479921.129569:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789479921.129601:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8d2283eaa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479921.129649:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526727168:12345-192.168.204.54@tcp:8: Request processed in 653us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479921.129658:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789479921.129675:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789479921.129680:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1876405526727296:12345-192.168.204.54@tcp:8: 00010000:00080000:0.0:1789479921.129697:0:6686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1789479921.129718:0:6686:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fd453 00002000:00100000:0.0:1789479921.129725:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f712dbb2-3172-402a-b822-94513dd5b6e3/ffff8d2283ea9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789479921.129732:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789479921.130000:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789479921.130017:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8d2283ea8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479921.130050:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526727296:12345-192.168.204.54@tcp:8: Request processed in 369us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479921.130056:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000004:00080000:2.0:1789479921.154847:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25465us 00000004:00200000:1.0:1789479921.199428:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789479921.199549:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5577:x1876405526727424:12345-192.168.204.54@tcp:33: Request processed in 70260us (70839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479921.199560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789479921.498571:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479921.507420:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915392:0@lo:13: 00000100:00100000:0.0:1789479921.507576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479921.507809:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915392 00000100:00100000:3.0:1789479921.507818:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915392 00000100:00100000:3.0:1789479921.507879:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479921.507891:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915392:12345-0@lo:13: 00002000:00000024:3.0:1789479921.507918:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479921.507978:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915392:12345-0@lo:13: Request processed in 90us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479921.507986:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789479921.508125:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452d500 x1876405551915392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479921.508148:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915392:0@lo:13: 00000100:00100000:1.0:1789479921.563510:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479921.563651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727680 00000100:00100000:2.0:1789479921.563663:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727680 00000100:00100000:2.0:1789479921.563772:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789479921.563803:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5617:x1876405526727680:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1789479921.563823:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479921.563849:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd45a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f30c1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.563917:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.563930:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.563945:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789479921.563983:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789479921.563987:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789479921.564004:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.564033:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd45a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c1 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.564063:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c1 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479921.564091:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d200) 00010000:00010000:2.0:1789479921.564095:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789479921.564099:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff800, rc 0) 00000100:00100000:2.0:1789479921.564264:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:5617:x1876405526727680:12345-192.168.204.54@tcp:101: Request processed in 472us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.564271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1789479921.692450:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479922.714674:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479923.738599:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479923.887942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479923.888035:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727808 00000100:00100000:3.0:1789479923.888047:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727808 00000100:00100000:3.0:1789479923.888160:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789479923.888174:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:5669:x1876405526727808:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1789479923.888229:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1789479923.889069:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479923.889172:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:5669:x1876405526727808:12345-192.168.204.54@tcp:41: Request processed in 186us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479923.889183:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1789479923.899939:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479923.900058:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526727936 00000100:00100000:3.0:1789479923.900070:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526727936 00000100:00100000:3.0:1789479923.900340:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789479923.900352:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5669:x1876405526727936:12345-192.168.204.54@tcp:13: 00002000:00000024:3.0:1789479923.900522:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479923.900612:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5669:x1876405526727936:12345-192.168.204.54@tcp:13: Request processed in 261us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479923.900619:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:0.0:1789479923.900828:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479923.907559:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479923.907850:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728064 00000100:00100000:3.0:1789479923.907861:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728064 00000100:00100000:3.0:1789479923.907943:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789479923.907956:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5669:x1876405526728064:12345-192.168.204.54@tcp:13: 00002000:00000024:3.0:1789479923.907998:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479923.908091:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f712dbb2-3172-402a-b822-94513dd5b6e3+6:5669:x1876405526728064:12345-192.168.204.54@tcp:13: Request processed in 138us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479923.908099:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:0.0:1789479923.908230:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789479924.137128:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00010000:00010000:2.0:1789479924.763541:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789479925.151106:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000001:00100000:3.0:1789479925.173604:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000100:00100000:1.0:1789479925.595027:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551915776:0@lo:400: 00000100:00100000:1.0:1789479925.595110:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479925.595173:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479925.595181:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915904:0@lo:400: 00000100:00100000:1.0:1789479925.595208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479925.595260:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915776 00000100:00100000:1.0:1789479925.595268:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915776 00000100:00100000:3.0:1789479925.595483:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551915520:0@lo:400: 00000100:00100000:3.0:1789479925.595530:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.595556:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551916032:0@lo:400: 00000100:00100000:3.0:1789479925.595577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.595594:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789479925.595600:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551915648:0@lo:400: 00000100:00100000:3.0:1789479925.595624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.595638:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551916160:0@lo:400: 00000100:00100000:3.0:1789479925.595655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.595693:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915520 00000100:00100000:3.0:1789479925.595697:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915520 00000100:00100000:3.0:1789479925.595749:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789479925.595758:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551915520:12345-0@lo:400: 00000100:00100000:3.0:1789479925.596637:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551915520:12345-0@lo:400: Request processed in 877us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.596648:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789479925.596706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916032 00000100:00100000:3.0:1789479925.596712:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916032 00000100:00100000:3.0:1789479925.596752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915648 00000100:00100000:3.0:1789479925.596756:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915648 00000100:00100000:3.0:1789479925.596770:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789479925.596985:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789479925.596995:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789479925.597021:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551915904 00000100:00100000:1.0:1789479925.597025:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551915904 00000100:00100000:1.0:1789479925.597054:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916160 00000100:00100000:1.0:1789479925.597057:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916160 00000100:00100000:1.0:1789479925.597073:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479925.597080:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915904:12345-0@lo:400: 00000100:00100000:1.0:1789479925.597133:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551915904:12345-0@lo:400: Request processed in 54us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.597139:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479925.597153:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479925.597158:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551916160:12345-0@lo:400: 00000100:00100000:1.0:1789479925.597186:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551916160:12345-0@lo:400: Request processed in 28us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.597191:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789479925.597209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479925.597213:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789479925.597216:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789479925.597669:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48de300 x1876405551916160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479925.597686:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551916160:0@lo:400: 00000100:00100000:0.0:1789479925.597699:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551915520:0@lo:400: 00000100:00100000:3.0:1789479925.597938:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551916032:12345-0@lo:400: 00010000:00080000:1.0:1789479925.598059:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ded80 x1876405551915904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479925.598070:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551915904:0@lo:400: 00000100:00100000:1.0:1789479925.598120:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789479925.598129:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551915648:12345-0@lo:400: 00000100:00100000:3.0:1789479925.598185:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551916032:12345-0@lo:400: Request processed in 1408us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.598192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789479925.598212:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789479925.598220:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479925.598227:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551915776:12345-0@lo:400: 00000100:00100000:3.0:1789479925.598270:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551915776:12345-0@lo:400: Request processed in 43us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.598276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479925.598351:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551915776:0@lo:400: 00000100:00100000:1.0:1789479925.603831:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551915648:12345-0@lo:400: Request processed in 5691us (8193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.603847:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789479925.605104:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551916032:0@lo:400: 00000100:00100000:0.0:1789479925.605145:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551915648:0@lo:400: 00010000:00010000:1.0:1789479925.786648:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479926.106783:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551916288:0@lo:13: 00000100:00100000:3.0:1789479926.106885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479926.107037:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916288 00000100:00100000:0.0:1789479926.107049:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916288 00000100:00100000:0.0:1789479926.107112:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479926.107122:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551916288:12345-0@lo:13: 00002000:00000024:0.0:1789479926.107164:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479926.107227:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551916288:12345-0@lo:13: Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479926.107257:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789479926.108511:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7f800 x1876405551916288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479926.108540:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551916288:0@lo:13: 00000100:00100000:2.0:1789479926.622322:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479926.622351:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551916416:0@lo:13: 00000100:00100000:2.0:1789479926.622424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479926.622593:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916416 00000100:00100000:1.0:1789479926.622602:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916416 00000100:00100000:1.0:1789479926.622947:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479926.622960:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551916416:12345-0@lo:13: 00002000:00000024:1.0:1789479926.623005:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479926.623076:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551916416:12345-0@lo:13: Request processed in 119us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479926.623083:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789479926.623267:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48af800 x1876405551916416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479926.623316:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551916416:0@lo:13: 00000100:00100000:2.0:1789479926.644028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479926.644077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479926.644110:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479926.644135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479926.644186:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728448 00000100:00100000:1.0:1789479926.644198:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728448 00000100:00100000:1.0:1789479926.644264:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728576 00000100:00100000:1.0:1789479926.644268:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728576 00000100:00100000:3.0:1789479926.644308:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728192 00000100:00100000:1.0:1789479926.644309:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789479926.644313:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728192 00000100:00100000:1.0:1789479926.644322:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526728448:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1789479926.644341:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1789479926.644348:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526728192:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1789479926.644410:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526728192:12345-192.168.204.54@tcp:400: Request processed in 62us (391us total) trans 0 rc 0/0 00000100:00080000:2.0:1789479926.644412:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479926.644416:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479926.644417:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1789479926.644453:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728320 00000100:00100000:3.0:1789479926.644458:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728320 00000100:00100000:3.0:1789479926.644501:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789479926.644509:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526728320:12345-192.168.204.54@tcp:400: 00000100:00080000:2.0:1789479926.644566:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479926.647393:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789479926.647408:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789479926.650009:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526728448:12345-192.168.204.54@tcp:400: Request processed in 5677us (5918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479926.650026:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789479926.650070:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789479926.650086:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526728576:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1789479926.650141:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526728576:12345-192.168.204.54@tcp:400: Request processed in 62us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479926.650157:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789479926.652466:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526728320:12345-192.168.204.54@tcp:400: Request processed in 7943us (8340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479926.652481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00010000:00010000:0.0:1789479926.812057:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789479927.032044:0:8300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789479927.835914:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479928.862404:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479929.883625:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479930.715235:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551916544:0@lo:400: 00000100:00100000:1.0:1789479930.715369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479930.715419:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551916672:0@lo:400: 00000100:00100000:0.0:1789479930.715533:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916544 00000100:00100000:0.0:1789479930.715544:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916544 00000100:00100000:0.0:1789479930.716022:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789479930.716038:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551916544:12345-0@lo:400: 00000100:00100000:0.0:1789479930.716147:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551916544:12345-0@lo:400: Request processed in 113us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.716154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789479930.718136:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551916544:0@lo:400: 00000100:00100000:1.0:1789479930.718160:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551917056:0@lo:400: 00000100:00100000:0.0:1789479930.719013:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551916928:0@lo:400: 00000100:00100000:0.0:1789479930.719104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.719153:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479930.719160:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551916800:0@lo:400: 00000100:00100000:0.0:1789479930.719211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479930.720394:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479930.720429:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551917184:0@lo:400: 00000100:00100000:2.0:1789479930.720491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479930.720571:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916928 00000100:00100000:2.0:1789479930.720579:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916928 00000100:00100000:2.0:1789479930.720653:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917184 00000100:00100000:2.0:1789479930.720657:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917184 00000100:00100000:2.0:1789479930.720699:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789479930.720712:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551916928:12345-0@lo:400: 00000100:00100000:3.0:1789479930.720734:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479930.720755:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551917184:12345-0@lo:400: 00000100:00100000:2.0:1789479930.720775:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551916928:12345-0@lo:400: Request processed in 66us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.720784:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789479930.720813:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479930.720818:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479930.720871:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551917184:12345-0@lo:400: Request processed in 123us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479930.720881:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789479930.721009:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48dc380 x1876405551917184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479930.721024:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551917184:0@lo:400: 00000100:00100000:1.0:1789479930.721948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479930.725591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916800 00000100:00100000:2.0:1789479930.725607:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916800 00000100:00100000:2.0:1789479930.725707:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551916672 00000100:00100000:2.0:1789479930.725711:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551916672 00000100:00100000:2.0:1789479930.725730:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917056 00000100:00100000:2.0:1789479930.725733:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917056 00000100:00100000:2.0:1789479930.725754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479930.725765:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551916800:12345-0@lo:400: 00000100:00100000:2.0:1789479930.725877:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551916800:12345-0@lo:400: Request processed in 113us (6664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.725888:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479930.725907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479930.725914:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551916672:12345-0@lo:400: 00000100:00100000:2.0:1789479930.725949:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551916672:12345-0@lo:400: Request processed in 36us (5559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.725973:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479930.725986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479930.725992:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551917056:12345-0@lo:400: 00000100:00100000:2.0:1789479930.726028:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551917056:12345-0@lo:400: Request processed in 36us (4083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.726034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789479930.726803:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479930.726855:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551916672:0@lo:400: 00000100:00100000:2.0:1789479930.728459:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551916800:0@lo:400: 00010000:00080000:2.0:1789479930.728486:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48dd880 x1876405551916928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479930.728497:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551916928:0@lo:400: 00000100:00100000:1.0:1789479930.728829:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551917056:0@lo:400: 00010000:00010000:2.0:1789479930.907646:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479931.226757:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789479931.226785:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551917312:0@lo:13: 00000100:00100000:2.0:1789479931.226871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479931.227130:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917312 00000100:00100000:3.0:1789479931.227140:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917312 00000100:00100000:3.0:1789479931.227205:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479931.227217:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551917312:12345-0@lo:13: 00002000:00000024:3.0:1789479931.227261:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479931.227346:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551917312:12345-0@lo:13: Request processed in 131us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479931.227355:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789479931.227389:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ac700 x1876405551917312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479931.227408:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551917312:0@lo:13: 00000020:00000080:0.0:1789479931.243062:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc6c40240 20000000:00000080:0.0:1789479931.243081:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22bb2e9c00 uarg=0000000000000000 20000000:01000000:0.0:1789479931.243190:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789479931.243193:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789479931.243196:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789479931.243201:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789479931.243206:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789479931.243273:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789479931.243500:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789479931.243731:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789479931.243735:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789479931.244891:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789479931.246994:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789479931.247071:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789479931.247108:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789479931.247119:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789479931.247122:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789479931.250060:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789479931.250536:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789479931.250588:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789479931.250678:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789479931.250695:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789479931.250698:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789479931.252990:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789479931.253843:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789479931.253920:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789479931.253960:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1789479931.253975:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789479931.253978:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789479931.265739:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789479931.267386:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789479931.267450:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789479931.267491:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1789479931.267509:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789479931.267532:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267554:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd35e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267562:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd388 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267570:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267579:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267600:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3ce expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267617:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd3ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267623:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267634:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267642:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267660:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267707:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267725:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 9 pid: 5823 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.267743:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917440:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789479931.267873:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267882:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 9 pid: 5824 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.267891:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917568:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789479931.267923:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.267931:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.267938:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917696:0@lo:104: 00000100:00100000:2.0:1789479931.267981:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479931.268022:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268041:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 18 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268050:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917824:0@lo:104: 00000100:00100000:2.0:1789479931.268075:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479931.268122:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268130:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268139:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917952:0@lo:104: 00010000:00010000:2.0:1789479931.268168:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268176:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268183:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918080:0@lo:104: 00010000:00010000:2.0:1789479931.268207:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268215:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268222:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918208:0@lo:104: 00010000:00010000:2.0:1789479931.268245:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268264:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268273:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918336:0@lo:104: 00010000:00010000:2.0:1789479931.268328:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.268336:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 18 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268345:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918464:0@lo:104: 00000100:00100000:2.0:1789479931.268363:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479931.268414:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789479931.268436:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.268449:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.268457:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.268466:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.268474:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.268484:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917696 00000100:00100000:0.0:1789479931.268493:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917696 00000100:00100000:0.0:1789479931.268538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917824 00000100:00100000:0.0:1789479931.268540:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917824 00000100:00100000:0.0:1789479931.268551:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551917952 00000100:00100000:0.0:1789479931.268553:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551917952 00000100:00100000:0.0:1789479931.268561:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918080 00000100:00100000:0.0:1789479931.268563:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918080 00000100:00100000:0.0:1789479931.268575:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918208 00000100:00100000:0.0:1789479931.268577:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918208 00000100:00100000:0.0:1789479931.268587:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918336 00000100:00100000:0.0:1789479931.268589:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918336 00000100:00100000:0.0:1789479931.268598:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918464 00000100:00100000:0.0:1789479931.268600:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918464 00000100:00100000:0.0:1789479931.268625:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479931.268634:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+9:8447:x1876405551917696:12345-0@lo:104: 00010000:00010000:0.0:1789479931.268659:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.268731:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479931.268737:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+9:8447:x1876405551917696:12345-0@lo:104: Request processed in 105us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.268754:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479931.268774:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789479931.268781:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+8:8447:x1876405551917824:12345-0@lo:104: 00010000:00010000:0.0:1789479931.268790:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.268843:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917696:0@lo:104: 00010000:00010000:0.0:1789479931.269055:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789479931.269061:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917824:0@lo:104: 00000100:00100000:0.0:1789479931.269061:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+8:8447:x1876405551917824:12345-0@lo:104: Request processed in 281us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.269068:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789479931.269098:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789479931.269100:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789479931.269105:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.269107:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+7:8447:x1876405551917952:12345-0@lo:104: 00010000:00010000:1.0:1789479931.269114:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2200 already unused, calling callback (ffffffffc1af9c20) 00010000:00010000:0.0:1789479931.269115:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479931.269118:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269127:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479931.269135:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479931.269151:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479931.269154:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479931.269159:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+7:8447:x1876405551917952:12345-0@lo:104: Request processed in 54us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.269164:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789479931.269176:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789479931.269180:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.269181:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+6:8447:x1876405551918080:12345-0@lo:104: 00010000:00010000:1.0:1789479931.269186:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479931.269188:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269211:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269218:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d2200/0xbb972366037fd40d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269232:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789479931.269235:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269241:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280031c00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789479931.269244:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269250:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479931.269257:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479931.269262:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479931.269299:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269306:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479931.269309:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479931.269315:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+6:8447:x1876405551918080:12345-0@lo:104: Request processed in 134us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.269326:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789479931.269337:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.269339:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789479931.269344:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280031c00/0xbb972366037fd3ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3f1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.269345:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+5:8447:x1876405551918208:12345-0@lo:104: 00010000:00010000:0.0:1789479931.269353:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269354:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789479931.269357:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269363:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280031200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789479931.269366:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269373:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479931.269379:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479931.269384:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479931.269397:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269403:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479931.269409:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269415:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269423:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789479931.269434:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269440:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789479931.269443:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269450:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479931.269456:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479931.269461:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479931.269474:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269480:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479931.269486:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269492:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4400/0xbb972366037fd3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.269501:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479931.269502:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479931.269504:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479931.269516:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551918720:0@lo:103: 00010000:00010000:0.0:1789479931.269516:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479931.269521:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+5:8447:x1876405551918208:12345-0@lo:104: Request processed in 177us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.269527:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479931.269540:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479931.269546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.269546:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:8447:x1876405551918336:12345-0@lo:104: 00010000:00010000:0.0:1789479931.269554:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.269568:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479931.269574:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551918848:0@lo:103: 00010000:00010000:0.0:1789479931.269578:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479931.269583:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:8447:x1876405551918336:12345-0@lo:104: Request processed in 38us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.269588:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789479931.269599:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479931.269613:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8447:x1876405551918464:12345-0@lo:104: 00010000:00010000:0.0:1789479931.269621:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.269624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.269658:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789479931.269663:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8447:x1876405551918464:12345-0@lo:104: Request processed in 59us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.269866:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551918592:0@lo:103: 00000100:00100000:2.0:1789479931.269893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.269926:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789479931.269932:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551918976:0@lo:103: 00000100:00100000:2.0:1789479931.269952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.269987:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917952:0@lo:104: 00000100:00100000:2.0:1789479931.269994:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918080:0@lo:104: 00000100:00100000:2.0:1789479931.270000:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918208:0@lo:104: 00000100:00100000:2.0:1789479931.270006:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918336:0@lo:104: 00000100:00100000:2.0:1789479931.270012:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551918464:0@lo:104: 00000100:00100000:1.0:1789479931.270062:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918720 00000100:00100000:1.0:1789479931.270067:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918720 00010000:00010000:1.0:1789479931.270093:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 19 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.270110:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918848 00000100:00100000:1.0:1789479931.270112:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918848 00010000:00010000:1.0:1789479931.270124:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 20 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.270133:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918592 00000100:00100000:1.0:1789479931.270135:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918592 00010000:00010000:1.0:1789479931.270145:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 21 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.270159:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551918976 00000100:00100000:1.0:1789479931.270163:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551918976 00010000:00010000:1.0:1789479931.270172:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 22 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.270182:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789479931.270188:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+22:3300:x1876405551918720:12345-0@lo:103: 00010000:00010000:1.0:1789479931.270199:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479931.270204:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 22 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270213:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 22 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270228:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2147200/0xbb972366037fd3f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd3ea expref: 22 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270248:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479931.270411:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+21:3300:x1876405551918720:12345-0@lo:103: Request processed in 223us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.270418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789479931.270431:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479931.270436:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+20:3300:x1876405551918848:12345-0@lo:103: 00010000:00010000:1.0:1789479931.270443:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479931.270447:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 20 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270456:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 20 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270464:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd3d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd3ce expref: 20 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270472:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479931.270493:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551918848:12345-0@lo:103: Request processed in 57us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.270498:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479931.270507:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789479931.270513:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+18:3299:x1876405551918592:12345-0@lo:103: 00010000:00010000:1.0:1789479931.270519:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479931.270522:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270530:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270548:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd40d expref: 18 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.270556:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479931.270582:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+17:3299:x1876405551918592:12345-0@lo:103: Request processed in 69us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.271425:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789479931.271450:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789479931.271458:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+16:3299:x1876405551918976:12345-0@lo:103: 00010000:00010000:1.0:1789479931.271469:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479931.271475:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 16 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.271485:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 16 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.271497:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030000/0xbb972366037fd3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd3c0 expref: 16 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.271508:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479931.271543:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+15:3299:x1876405551918976:12345-0@lo:103: Request processed in 87us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.271548:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789479931.271713:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551918976:0@lo:103: 00000100:00100000:2.0:1789479931.271734:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551918592:0@lo:103: 00000100:00100000:2.0:1789479931.271770:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551918848:0@lo:103: 00000100:00100000:2.0:1789479931.271778:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551918720:0@lo:103: 00000100:00100000:2.0:1789479931.272200:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917440:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789479931.272211:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1876405551917568:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789479931.272249:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.272507:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789479931.272557:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789479931.272566:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272574:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789479931.272578:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272587:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.272681:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.272687:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.272733:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272740:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.272786:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272793:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2146600/0xbb972366037fd3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd3b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272804:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789479931.272807:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272814:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789479931.272817:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272824:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.272830:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.272835:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.272849:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272855:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.272869:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272876:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5800/0xbb972366037fd388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd38f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272885:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789479931.272895:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272901:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789479931.272903:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272911:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.272917:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.272923:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.272936:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272940:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.272948:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272953:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2147c00/0xbb972366037fd35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd365 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.272966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479931.272967:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479931.272969:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479931.272983:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551919360:0@lo:103: 00000100:00100000:2.0:1789479931.273032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.273087:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479931.273092:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551919232:0@lo:103: 00000100:00100000:2.0:1789479931.273120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479931.273144:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479931.273155:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919360 00000100:00100000:2.0:1789479931.273162:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919360 00010000:00010000:2.0:1789479931.273190:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 15 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.273212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919232 00000100:00100000:2.0:1789479931.273214:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919232 00010000:00010000:2.0:1789479931.273225:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 16 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.273237:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789479931.273244:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+16:3301:x1876405551919360:12345-0@lo:103: 00010000:00010000:2.0:1789479931.273256:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.273261:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 16 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.273273:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 16 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.273491:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789479931.273503:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789479931.273630:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789479931.273638:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+16:3301:x1876405551919232:12345-0@lo:103: 00000100:00100000:3.0:1789479931.273791:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551919104:0@lo:103: 00000100:00100000:3.0:1789479931.273829:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479931.273861:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789479931.273868:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919104 00000100:00100000:3.0:1789479931.273871:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919104 00010000:00010000:3.0:1789479931.273887:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 17 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479931.274559:0:8452:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789479931.274568:0:8452:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789479931.274760:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd35e expref: 17 pid: 5825 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.274780:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479931.274855:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+16:3301:x1876405551919360:12345-0@lo:103: Request processed in 1610us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.274863:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789479931.274887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479931.274896:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+15:3299:x1876405551919104:12345-0@lo:103: 00010000:00010000:2.0:1789479931.274921:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.274928:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 15 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.274939:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 15 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.274955:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd3b2 expref: 15 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.274963:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479931.275003:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+14:3299:x1876405551919104:12345-0@lo:103: Request processed in 110us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.275011:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789479931.275642:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.275652:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 13 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.275673:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 13 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.275685:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2600/0xbb972366037fd38f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd388 expref: 13 pid: 5824 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.275696:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.275730:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+12:3301:x1876405551919232:12345-0@lo:103: Request processed in 2094us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.275736:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479931.276018:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551919104:0@lo:103: 00000100:00100000:3.0:1789479931.276125:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551919232:0@lo:103: 00000100:00100000:3.0:1789479931.276134:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551919360:0@lo:103: 00000100:00100000:1.0:1789479931.277085:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479931.277124:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479931.277202:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728832 00000100:00100000:2.0:1789479931.277210:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728832 00010000:00010000:2.0:1789479931.277248:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 10 pid: 5824 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.277275:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728704 00000100:00100000:2.0:1789479931.277278:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728704 00010000:00010000:2.0:1789479931.277515:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 11 pid: 5823 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.277543:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789479931.277552:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:2348:x1876405526728832:12345-192.168.204.54@tcp:103: 00010000:00010000:2.0:1789479931.277569:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.277574:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 11 pid: 5824 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.277617:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 11 pid: 5824 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.277635:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280031400/0xbb972366037fd429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f305f expref: 11 pid: 5824 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.277642:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:2.0:1789479931.277652:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.277663:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526728704:12345-192.168.204.54@tcp:103: 00010000:00010000:0.0:1789479931.277679:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.277684:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 10 pid: 5823 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277695:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 10 pid: 5823 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277715:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3066 expref: 10 pid: 5823 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.277716:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526728832:12345-192.168.204.54@tcp:103: Request processed in 166us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.277724:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:0.0:1789479931.277727:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277736:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277754:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277762:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277769:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277775:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277782:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789479931.277786:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277794:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277823:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.277847:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789479931.277869:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.277871:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:2347:x1876405526728704:12345-192.168.204.54@tcp:103: Request processed in 211us (746us total) trans 0 rc 0/0 00010000:00010000:2.0:1789479931.277878:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.277878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:2.0:1789479931.277884:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bafffc00/0xbb972366037fd468 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.738990:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479931.739022:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551919488:0@lo:13: 00000100:00100000:0.0:1789479931.739105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.742193:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919488 00000100:00100000:2.0:1789479931.742211:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919488 00000100:00100000:2.0:1789479931.742331:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789479931.742342:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551919488:12345-0@lo:13: 00002000:00000024:2.0:1789479931.742384:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479931.742482:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551919488:12345-0@lo:13: Request processed in 142us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.742489:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789479931.742983:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8ed80 x1876405551919488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479931.743008:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551919488:0@lo:13: 00000100:00100000:1.0:1789479931.761407:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479931.761568:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729088 00000100:00100000:2.0:1789479931.761585:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729088 00000100:00100000:1.0:1789479931.761895:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479931.761923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479931.761984:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526728960 00000100:00100000:1.0:1789479931.761989:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526728960 00000100:00100000:3.0:1789479931.762002:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729216 00000100:00100000:3.0:1789479931.762006:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729216 00000100:00100000:3.0:1789479931.762035:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789479931.762035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1789479931.762044:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526729216:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1789479931.762044:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526728960:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1789479931.762263:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1789479931.762272:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526729088:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1789479931.762346:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526728960:12345-192.168.204.54@tcp:400: Request processed in 302us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.762354:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00080000:0.0:1789479931.762375:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479931.762380:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479931.762383:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479931.766087:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526729088:12345-192.168.204.54@tcp:400: Request processed in 3803us (4678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.766104:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789479931.777984:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526729216:12345-192.168.204.54@tcp:400: Request processed in 15918us (16036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479931.778003:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:2.0:1789479931.933974:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479932.956049:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789479933.082406:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789479933.082415:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22b9aa2800 from 39 10000000:01000000:0.0:1789479933.082422:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479933.082479:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.082492:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.082506:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479933.082532:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919616:0@lo:101: 00000100:00100000:0.0:1789479933.082629:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.082704:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.082713:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919616 00000100:00100000:3.0:1789479933.082726:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919616 00000100:00100000:3.0:1789479933.082790:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789479933.082799:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+12:5827:x1876405551919616:12345-0@lo:101: 00010000:00010000:3.0:1789479933.082814:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479933.082829:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fd476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd46f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.082854:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd46f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.082866:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fd476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd46f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.082874:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5a00, rc 0) 00000100:00100000:3.0:1789479933.082931:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551919616:12345-0@lo:101: Request processed in 132us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.082937:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789479933.083056:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919616:0@lo:101: 00010000:00010000:2.0:1789479933.083081:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.083090:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.083148:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919744:0@lo:501: 00000100:00100000:2.0:1789479933.083188:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.083213:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.083600:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919744 00000100:00100000:3.0:1789479933.083605:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919744 00000100:00100000:3.0:1789479933.083636:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789479933.083643:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551919744:12345-0@lo:501: 00000100:00100000:3.0:1789479933.083905:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551919744:12345-0@lo:501: Request processed in 262us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.083913:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789479933.084185:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919744:0@lo:501: 00000100:00100000:2.0:1789479933.084216:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919872:0@lo:503: 00000100:00100000:2.0:1789479933.084256:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.084312:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.084430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551919872 00000100:00100000:1.0:1789479933.084435:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551919872 00000100:00100000:1.0:1789479933.084471:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789479933.084478:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551919872:12345-0@lo:503: 00000100:00100000:1.0:1789479933.084655:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551919872:12345-0@lo:503: Request processed in 177us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.084662:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789479933.085394:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551919872:0@lo:503: 00000100:00100000:2.0:1789479933.097340:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8465:1876405551920000:0@lo:502: 00000100:00100000:2.0:1789479933.097439:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.097503:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.097695:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920000 00000100:00100000:0.0:1789479933.097704:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920000 00000100:00100000:0.0:1789479933.097758:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789479933.097768:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:8465:x1876405551920000:12345-0@lo:502: 00000100:00100000:0.0:1789479933.098495:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:8465:x1876405551920000:12345-0@lo:502: Request processed in 726us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.098505:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789479933.099246:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8465:1876405551920000:0@lo:502: 00000100:00100000:2.0:1789479933.099338:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8465:1876405551920128:0@lo:502: 00000100:00100000:2.0:1789479933.099389:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.099481:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.107056:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920128 00000100:00100000:3.0:1789479933.107074:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920128 00000100:00100000:3.0:1789479933.107144:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789479933.107154:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:8465:x1876405551920128:12345-0@lo:502: 00000100:00100000:3.0:1789479933.107503:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+13:8465:x1876405551920128:12345-0@lo:502: Request processed in 350us (8114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.107512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789479933.110076:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8465:1876405551920128:0@lo:502: 00000040:00080000:0.0:1789479933.110131:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789479933.110379:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789479933.110399:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479933.110411:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.110425:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479933.110436:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789479933.110439:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789479933.110442:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789479933.110481:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.110490:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.110500:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.110520:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920256:0@lo:101: 00000100:00100000:2.0:1789479933.110595:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.110637:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.110847:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920256 00000100:00100000:0.0:1789479933.110854:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920256 00000100:00100000:0.0:1789479933.110909:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789479933.110919:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+13:5827:x1876405551920256:12345-0@lo:101: 00010000:00010000:0.0:1789479933.110932:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479933.110944:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280031400/0xbb972366037fd484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd47d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.110967:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280031400/0xbb972366037fd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd47d expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.110977:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280031400/0xbb972366037fd484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd47d expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.110986:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280031400, rc 0) 00000100:00100000:0.0:1789479933.111047:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920256:12345-0@lo:101: Request processed in 130us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.111054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789479933.111217:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920256:0@lo:101: 00010000:00010000:2.0:1789479933.111244:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.111254:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.111338:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920384:0@lo:501: 00000100:00100000:2.0:1789479933.111367:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.111387:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.114761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920384 00000100:00100000:0.0:1789479933.114777:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920384 00000100:00100000:0.0:1789479933.114841:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789479933.114852:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920384:12345-0@lo:501: 00000100:00100000:0.0:1789479933.115203:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920384:12345-0@lo:501: Request processed in 352us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.115218:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789479933.115470:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920384:0@lo:501: 00000100:00100000:2.0:1789479933.115521:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920512:0@lo:503: 00000100:00100000:2.0:1789479933.115588:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.115620:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.115698:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920512 00000100:00100000:3.0:1789479933.115703:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920512 00000100:00100000:3.0:1789479933.115742:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789479933.115749:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920512:12345-0@lo:503: 00000100:00100000:3.0:1789479933.115899:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920512:12345-0@lo:503: Request processed in 150us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.115906:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789479933.115991:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920512:0@lo:503: 00000100:00100000:2.0:1789479933.118070:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8466:1876405551920640:0@lo:502: 00000100:00100000:2.0:1789479933.118163:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.118209:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.118346:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920640 00000100:00100000:3.0:1789479933.118354:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920640 00000100:00100000:3.0:1789479933.118398:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789479933.118406:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8466:x1876405551920640:12345-0@lo:502: 00000100:00100000:3.0:1789479933.118621:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+14:8466:x1876405551920640:12345-0@lo:502: Request processed in 215us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.118629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789479933.118744:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8466:1876405551920640:0@lo:502: 00000020:01000000:0.0:1789479933.118773:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479933.118783:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479933.118787:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789479933.118793:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789479933.118817:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8466:1876405551920768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.118851:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.118871:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.118920:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920768 00000100:00100000:3.0:1789479933.118925:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920768 00000100:00100000:3.0:1789479933.118954:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789479933.118961:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:8466:x1876405551920768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.119084:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:8466:x1876405551920768:12345-0@lo:502:llog_process_th.0 Request processed in 123us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.119100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789479933.119333:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8466:1876405551920768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479933.119353:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479933.119358:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479933.119360:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789479933.119364:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789479933.120161:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789479933.120182:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789479933.120192:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.120204:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479933.120215:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789479933.120218:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22a4535800 from 39 10000000:01000000:3.0:1789479933.120221:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479933.120253:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.120262:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.120271:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.120324:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.120370:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.120402:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.120479:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551920896 00000100:00100000:0.0:1789479933.120485:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551920896 00000100:00100000:0.0:1789479933.120525:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789479933.120534:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+14:5827:x1876405551920896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479933.120545:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479933.120556:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280030000/0xbb972366037fd492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd48b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.120590:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030000/0xbb972366037fd492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd48b expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.120602:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280030000/0xbb972366037fd492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd48b expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.120626:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280030000, rc 0) 00000100:00100000:0.0:1789479933.120673:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551920896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.120680:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789479933.120951:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479933.121022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729344 00000100:00100000:3.0:1789479933.121034:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729344 00000100:00100000:3.0:1789479933.121067:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:3.0:1789479933.121074:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:5592:x1876405526729344:12345-192.168.204.54@tcp:101: 00010000:00010000:3.0:1789479933.121091:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479933.121101:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4c00/0xbb972366037fd499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f30c8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.121118:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4c00/0xbb972366037fd499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.121126:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4c00/0xbb972366037fd499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.121134:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4c00, rc 0) 00000100:00100000:3.0:1789479933.121175:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729344:12345-192.168.204.54@tcp:101: Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.121180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1789479933.122614:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551920896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479933.122689:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.122702:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.122773:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.122834:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.122872:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.123395:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921024 00000100:00100000:3.0:1789479933.123402:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921024 00000100:00100000:3.0:1789479933.123447:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789479933.123455:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551921024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.123738:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551921024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.123746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789479933.127567:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479933.127670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729472 00000100:00100000:2.0:1789479933.127680:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729472 00000100:00100000:2.0:1789479933.127738:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1789479933.127749:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729472:12345-192.168.204.54@tcp:501: 00000100:00100000:2.0:1789479933.128075:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729472:12345-192.168.204.54@tcp:501: Request processed in 327us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.128083:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1789479933.128142:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.128191:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.128243:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.128278:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.128494:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921152 00000100:00100000:0.0:1789479933.128499:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921152 00000100:00100000:0.0:1789479933.128522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789479933.128528:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551921152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.128677:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551921152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.128684:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789479933.130705:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.131083:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8467:1876405551921280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.131161:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.131207:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.131336:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921280 00000100:00100000:3.0:1789479933.131343:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921280 00000100:00100000:3.0:1789479933.131389:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789479933.131399:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:8467:x1876405551921280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.131693:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+15:8467:x1876405551921280:12345-0@lo:502:llog_process_th.0 Request processed in 294us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.131711:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789479933.131937:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8467:1876405551921280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.131991:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8467:1876405551921408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.132038:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.132073:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.132183:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921408 00000100:00100000:0.0:1789479933.132188:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921408 00000100:00100000:0.0:1789479933.132215:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789479933.132222:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:8467:x1876405551921408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.132406:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+15:8467:x1876405551921408:12345-0@lo:502:llog_process_th.0 Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.132413:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789479933.132693:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8467:1876405551921408:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789479933.132717:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789479933.132887:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789479933.132908:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479933.132918:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.132937:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479933.132948:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789479933.132951:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789479933.132954:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789479933.132981:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.132990:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.132999:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479933.133016:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.133135:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.133168:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.133218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921536 00000100:00100000:1.0:1789479933.133223:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921536 00000100:00100000:1.0:1789479933.133256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789479933.133263:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+15:5827:x1876405551921536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.133272:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.133319:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd4a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4a0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.133342:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4a0 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.133354:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4a0 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.133364:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147a00, rc 0) 00000100:00100000:1.0:1789479933.133398:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551921536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.133405:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789479933.133976:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479933.133994:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.134017:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.134150:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.134189:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.134376:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.142369:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921664 00000100:00100000:3.0:1789479933.142384:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921664 00000100:00100000:3.0:1789479933.142442:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789479933.142453:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551921664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.142827:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479933.143127:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551921664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 675us (8935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.143137:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789479933.143170:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729600 00000100:00100000:3.0:1789479933.143174:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729600 00000100:00100000:3.0:1789479933.143191:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:3.0:1789479933.143198:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729600:12345-192.168.204.54@tcp:503: 00000100:00100000:3.0:1789479933.143385:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729600:12345-192.168.204.54@tcp:503: Request processed in 185us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.143393:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:1.0:1789479933.149642:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479933.149772:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.149774:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729728 00000100:00100000:3.0:1789479933.149786:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729728 00000100:00100000:2.0:1789479933.149840:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.149888:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:3.0:1789479933.149900:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:6064:x1876405526729728:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1789479933.149908:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.150210:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:6064:x1876405526729728:12345-192.168.204.54@tcp:502: Request processed in 312us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.150219:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:1.0:1789479933.154363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921792 00000100:00100000:1.0:1789479933.154380:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921792 00000100:00100000:0.0:1789479933.156670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789479933.156697:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551921792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.157609:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551921792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 923us (7699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.157621:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789479933.159232:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.159265:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551921792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.160602:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8468:1876405551921920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.160684:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.160728:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8780 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.160783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551921920 00000100:00100000:2.0:1789479933.160791:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551921920 00000100:00100000:2.0:1789479933.160836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789479933.160845:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8468:x1876405551921920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.161056:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8468:x1876405551921920:12345-0@lo:502:llog_process_th.0 Request processed in 211us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.161063:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789479933.161308:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8468:1876405551921920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479933.161341:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479933.161351:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479933.161353:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789479933.161360:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789479933.161380:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8468:1876405551922048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.161412:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.161433:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8780 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.161707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922048 00000100:00100000:2.0:1789479933.161711:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922048 00000100:00100000:2.0:1789479933.161742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789479933.161749:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8468:x1876405551922048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.161916:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:8468:x1876405551922048:12345-0@lo:502:llog_process_th.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.161929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789479933.162089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479933.162138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729856 00000100:00100000:2.0:1789479933.162142:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729856 00000100:00100000:2.0:1789479933.162171:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:2.0:1789479933.162179:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:6064:x1876405526729856:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789479933.162731:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:6064:x1876405526729856:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 551us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.162739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:3.0:1789479933.165666:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8468:1876405551922048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.165722:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479933.165734:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.165747:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789479933.165752:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789479933.165884:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789479933.165908:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789479933.165920:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.165932:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479933.165943:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789479933.165946:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22aea50800 from 39 10000000:01000000:2.0:1789479933.165949:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789479933.165986:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.165995:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.166005:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.166040:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.166114:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.166198:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922176 00000100:00100000:0.0:1789479933.166206:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922176 00000100:00100000:1.0:1789479933.166313:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789479933.166332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551922176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.166347:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.166361:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2146e00/0xbb972366037fd4b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.166385:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2146e00/0xbb972366037fd4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4ae expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.166397:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2146e00/0xbb972366037fd4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4ae expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.166407:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146e00, rc 0) 00000100:00100000:2.0:1789479933.166737:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.171949:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5613us (5822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.171979:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789479933.172000:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479933.172438:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.172467:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.172482:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.172556:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.172609:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.175471:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526729984 00000100:00100000:1.0:1789479933.175488:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526729984 00000100:00100000:1.0:1789479933.175611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:1.0:1789479933.175623:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526729984:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.175650:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.175680:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2146000/0xbb972366037fd4bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f30cf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.175712:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2146000/0xbb972366037fd4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30cf expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.175725:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2146000/0xbb972366037fd4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30cf expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.175735:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146000, rc 0) 00000100:00100000:1.0:1789479933.175805:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526729984:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 184us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.175813:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:3.0:1789479933.180564:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228807f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.180663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922304 00000100:00100000:1.0:1789479933.180672:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922304 00000100:00100000:1.0:1789479933.180724:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789479933.180733:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.181517:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479933.181612:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730112 00000100:00100000:3.0:1789479933.181618:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730112 00000100:00100000:3.0:1789479933.181704:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:3.0:1789479933.181712:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730112:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.181871:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730112:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 159us (357us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789479933.181880:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:3.0:1789479933.181935:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.181986:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.182430:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (8415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.182442:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789479933.184906:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.185006:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2288b42b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.185110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922432 00000100:00100000:2.0:1789479933.185122:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922432 00000100:00100000:2.0:1789479933.185641:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789479933.185654:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.185916:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.185925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789479933.186017:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.186743:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8469:1876405551922560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.186799:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.187158:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2288b42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.187230:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922560 00000100:00100000:0.0:1789479933.187236:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922560 00000100:00100000:0.0:1789479933.187267:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789479933.187274:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8469:x1876405551922560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.187497:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8469:x1876405551922560:12345-0@lo:502:llog_process_th.0 Request processed in 223us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.187505:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789479933.187612:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8469:1876405551922560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.187671:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8469:1876405551922688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.187704:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.187721:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd71d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.187821:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922688 00000100:00100000:0.0:1789479933.187826:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922688 00000100:00100000:0.0:1789479933.187844:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789479933.188016:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8469:x1876405551922688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.188456:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8469:x1876405551922688:12345-0@lo:502:llog_process_th.0 Request processed in 442us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.188465:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789479933.188999:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8469:1876405551922688:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789479933.189105:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789479933.189625:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789479933.189727:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789479933.189739:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.189752:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479933.189762:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789479933.189765:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789479933.189768:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789479933.189800:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.189809:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.189819:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.189838:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.189888:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.189928:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.189979:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922816 00000100:00100000:0.0:1789479933.189985:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922816 00000100:00100000:0.0:1789479933.190034:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789479933.190042:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551922816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479933.190063:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479933.190075:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280031a00/0xbb972366037fd4ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4c3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.190098:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280031a00/0xbb972366037fd4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4c3 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.190109:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280031a00/0xbb972366037fd4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4c3 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.190118:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280031a00, rc 0) 00000100:00100000:0.0:1789479933.190163:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551922816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.190169:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789479933.190481:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.190495:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.190504:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.190564:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.190604:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.190627:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.190870:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551922944 00000100:00100000:3.0:1789479933.190875:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551922944 00000100:00100000:3.0:1789479933.190917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789479933.190925:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551922944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.193423:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551922944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2489us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.193438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789479933.193531:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551922944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.193600:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.193809:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.193841:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd71d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.193859:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923072 00000100:00100000:3.0:1789479933.193865:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923072 00000100:00100000:3.0:1789479933.193898:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789479933.193906:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551923072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.195053:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551923072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1142us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.195073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789479933.198971:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.200915:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8470:1876405551923200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.201014:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.201199:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.201772:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923200 00000100:00100000:0.0:1789479933.201781:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923200 00000100:00100000:0.0:1789479933.201883:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789479933.201895:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:8470:x1876405551923200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.202485:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:8470:x1876405551923200:12345-0@lo:502:llog_process_th.0 Request processed in 590us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.202493:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789479933.202977:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8470:1876405551923200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.203019:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479933.203041:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.203044:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789479933.203051:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789479933.203086:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8470:1876405551923328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.203138:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.203461:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776480 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.203550:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923328 00000100:00100000:2.0:1789479933.203557:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923328 00000100:00100000:2.0:1789479933.203603:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789479933.203611:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8470:x1876405551923328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.203966:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8470:x1876405551923328:12345-0@lo:502:llog_process_th.0 Request processed in 355us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.203974:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789479933.204134:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8470:1876405551923328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.204236:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479933.204242:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.204244:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789479933.204248:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789479933.204597:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789479933.204625:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789479933.204764:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.204787:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479933.204797:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789479933.204799:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d229c723380 from 1 10000000:01000000:2.0:1789479933.204802:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789479933.204835:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.204844:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.204853:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.204875:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.204922:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.205003:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.205278:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923456 00000100:00100000:1.0:1789479933.205385:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923456 00000100:00100000:1.0:1789479933.205461:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789479933.205471:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551923456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.205484:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.205497:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd4d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4d1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.205521:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4d1 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.205532:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4d1 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.205541:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146c00, rc 0) 00000100:00100000:1.0:1789479933.205607:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551923456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.205614:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789479933.205694:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479933.205711:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.205721:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.205773:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.205801:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.206171:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.206316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923584 00000100:00100000:0.0:1789479933.206322:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923584 00000100:00100000:0.0:1789479933.206349:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789479933.206357:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551923584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.206589:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551923584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (789us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479933.206603:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789479933.206830:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551923584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789479933.206856:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789479933.206864:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.206873:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.979809:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789479934.552593:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeb20e7d0 20000000:00000080:0.0:1789479934.552614:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22bd7c7c00 uarg=0000000000000000 20000000:01000000:0.0:1789479934.552654:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789479934.552660:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789479934.552665:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789479934.557790:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789479934.558031:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789479934.563258:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789479934.563453:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789479934.563527:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789479934.563560:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789479934.563584:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563607:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd24d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563615:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd2af expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563622:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd37a expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563631:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563638:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563679:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563707:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 9 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.563723:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923712:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789479934.563835:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563845:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 18 pid: 5825 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.563855:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923840:0@lo:104: 00000100:00100000:0.0:1789479934.563895:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479934.563942:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.563952:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 18 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.563960:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923968:0@lo:104: 00000100:00100000:0.0:1789479934.563984:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479934.564103:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789479934.564117:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923840 00000100:00100000:0.0:1789479934.564204:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923840 00000100:00100000:0.0:1789479934.564245:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551923968 00000100:00100000:0.0:1789479934.564248:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551923968 00000100:00100000:0.0:1789479934.564263:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789479934.564271:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:8509:x1876405551923840:12345-0@lo:104: 00010000:00010000:0.0:1789479934.564307:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.564365:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479934.564372:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:8509:x1876405551923840:12345-0@lo:104: Request processed in 102us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479934.564381:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789479934.564399:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789479934.564405:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8509:x1876405551923968:12345-0@lo:104: 00010000:00010000:0.0:1789479934.564413:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.564445:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479934.564450:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8509:x1876405551923968:12345-0@lo:104: Request processed in 46us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479934.564456:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789479934.564500:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.564509:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 18 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.564517:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551924096:0@lo:104: 00000100:00100000:0.0:1789479934.564540:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479934.564573:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924096 00000100:00100000:0.0:1789479934.564577:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924096 00000100:00100000:0.0:1789479934.564593:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479934.564599:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8509:x1876405551924096:12345-0@lo:104: 00010000:00010000:0.0:1789479934.564606:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.564643:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789479934.564648:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:8509:x1876405551924096:12345-0@lo:104: Request processed in 50us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479934.564655:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479934.564673:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789479934.564694:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923840:0@lo:104: 00000100:00100000:0.0:1789479934.564702:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923968:0@lo:104: 00000100:00100000:0.0:1789479934.564709:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551924096:0@lo:104: 00010000:00010000:3.0:1789479934.565457:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789479934.565467:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565476:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479934.565480:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565489:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479934.565506:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479934.565527:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789479934.565573:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565579:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479934.565602:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565609:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2147000/0xbb972366037fd37a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd381 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565634:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479934.565638:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565643:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7139a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479934.565646:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565653:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479934.565658:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479934.565663:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789479934.565675:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565680:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479934.565702:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565707:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7139a00/0xbb972366037fd2af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd2b6 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565718:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479934.565721:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565727:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789479934.565729:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565735:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479934.565741:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479934.565746:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789479934.565757:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565762:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479934.565766:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565772:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d2e00/0xbb972366037fd24d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd254 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.565785:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479934.565792:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479934.565794:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479934.566083:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551924224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789479934.566143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479934.566922:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479934.566937:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551924352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789479934.566980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479934.567084:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479934.567092:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551924480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789479934.567116:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479934.567938:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924224 00000100:00100000:0.0:1789479934.567948:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924224 00010000:00010000:0.0:1789479934.567998:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 19 pid: 5825 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.568036:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924352 00000100:00100000:0.0:1789479934.568039:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924352 00010000:00010000:0.0:1789479934.568053:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 20 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.568068:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924480 00000100:00100000:0.0:1789479934.568071:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924480 00010000:00010000:0.0:1789479934.568083:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 21 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479934.568098:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479934.568106:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+21:3299:x1876405551924224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789479934.568120:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789479934.568213:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789479934.568223:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+21:3300:x1876405551924352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479934.568231:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479934.568237:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 21 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568248:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 21 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568264:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22b7138a00/0xbb972366037fd2b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd2af expref: 21 pid: 5823 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568302:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479934.568360:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+20:3300:x1876405551924352:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479934.568367:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789479934.568389:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479934.568396:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551924480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479934.568404:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479934.568409:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 19 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568418:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 19 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568429:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22b7139e00/0xbb972366037fd254 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd24d expref: 19 pid: 5824 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479934.568460:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479934.568486:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+18:3300:x1876405551924480:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479934.568493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789479934.568811:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 17 pid: 5825 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.568830:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 17 pid: 5825 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.568841:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2800/0xbb972366037fd381 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd37a expref: 17 pid: 5825 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.568852:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479934.568898:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+16:3299:x1876405551924224:12345-0@lo:103:ldlm_bl.0 Request processed in 793us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479934.568906:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479934.569054:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551924224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479934.569391:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551924480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479934.569400:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551924352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789479934.570003:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479934.570276:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730240 00000100:00100000:3.0:1789479934.570349:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730240 00000100:00100000:0.0:1789479934.570468:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1876405551923712:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789479934.570565:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570691:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479934.570766:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1789479934.570775:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526730240:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789479934.570787:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479934.570793:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570806:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570821:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bafff000/0xbb972366037fd43e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3097 expref: 10 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570837:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570846:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570861:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570869:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570876:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570883:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570899:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789479934.570903:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570911:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570931:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479934.570941:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479934.571013:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:2348:x1876405526730240:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 237us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479934.571021:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:0.0:1789479934.571067:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.571074:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479934.571081:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030c00/0xbb972366037fd4df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479935.005221:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479935.836508:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551924864:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.836594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.836651:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479935.836660:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551924736:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.836661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551924992:0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.836711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.836717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479935.836740:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551925248:0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.836768:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.836783:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924864 00000100:00100000:0.0:1789479935.836793:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924864 00000100:00100000:2.0:1789479935.836800:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789479935.836808:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551924608:0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.836840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.836848:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924736 00000100:00100000:0.0:1789479935.836853:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924736 00000100:00100000:2.0:1789479935.836866:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551925120:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.836882:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789479935.836891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.836894:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551924864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.836960:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551924864:12345-0@lo:400:kworker.0 Request processed in 69us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.836969:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925120 00000100:00100000:0.0:1789479935.836969:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479935.836976:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925120 00000100:00100000:0.0:1789479935.836992:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479935.837001:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551924736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.837007:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789479935.837019:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551925120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837037:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551924736:12345-0@lo:400:kworker.0 Request processed in 38us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.837044:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479935.837066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924992 00000100:00100000:1.0:1789479935.837068:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551925120:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.837071:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924992 00000100:00100000:1.0:1789479935.837080:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789479935.837102:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925248 00000100:00100000:0.0:1789479935.837105:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925248 00000100:00100000:0.0:1789479935.837136:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479935.837144:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551924992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.837161:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551924864:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837180:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551924992:12345-0@lo:400:kworker.0 Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.837187:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789479935.837191:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948700 x1876405551924992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.837202:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789479935.837205:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551924992:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837212:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551925248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837237:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551925248:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.837253:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789479935.837273:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479935.837278:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789479935.837297:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479935.837313:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551924608 00000100:00100000:0.0:1789479935.837316:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551924608 00000100:00100000:0.0:1789479935.837349:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789479935.837356:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:3299:x1876405551924608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837385:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:3299:x1876405551924608:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.837391:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789479935.837428:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551924608:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837439:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551925120:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.837447:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551924736:0@lo:400:kworker.0 00010000:00080000:0.0:1789479935.837456:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948380 x1876405551925248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.837464:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551925248:0@lo:400:kworker.0 00010000:00010000:2.0:1789479936.028505:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479936.348804:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551925376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479936.348886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479936.349671:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925376 00000100:00100000:1.0:1789479936.349680:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925376 00000100:00100000:1.0:1789479936.349742:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789479936.349752:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551925376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479936.349789:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479936.349849:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551925376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.349864:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789479936.349955:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac6680 x1876405551925376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479936.349976:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551925376:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1789479936.410345:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789479936.410361:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22b9aa2800 from 4 10000000:01000000:0.0:1789479936.410367:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789479936.410419:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479936.410433:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479936.410447:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479936.410491:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479936.410588:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479936.410641:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545540 going to sleep for 11 seconds 00000100:00100000:2.0:1789479936.411996:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925504 00000100:00100000:2.0:1789479936.412007:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925504 00000100:00100000:2.0:1789479936.412061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789479936.412071:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551925504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479936.412085:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479936.412106:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4e6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479936.412133:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479936.412157:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479936.412166:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffee00, rc 0) 00000100:00100000:2.0:1789479936.412243:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551925504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.412250:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789479936.412318:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479936.412336:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479936.412356:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479936.412424:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.412456:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.412475:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789479936.412489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925632 00000100:00100000:2.0:1789479936.412493:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925632 00000100:00100000:2.0:1789479936.412526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789479936.412532:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551925632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.412806:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551925632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.412814:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789479936.413278:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.413337:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.413379:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.413401:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479936.413779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925760 00000100:00100000:1.0:1789479936.413784:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925760 00000100:00100000:1.0:1789479936.413822:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789479936.413936:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551925760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479936.414156:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551925760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.414201:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551925760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.417728:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8586:1876405551925888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479936.417813:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.417964:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551925888 00000100:00100000:3.0:1789479936.417971:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551925888 00000100:00100000:1.0:1789479936.418433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789479936.419986:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.423114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789479936.423141:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:8586:x1876405551925888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479936.425369:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:8586:x1876405551925888:12345-0@lo:502:llog_process_th.0 Request processed in 2235us (7549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.425382:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789479936.425532:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8586:1876405551925888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479936.425582:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479936.425594:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479936.425597:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789479936.425609:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22b9aa2800 00000020:00000080:1.0:1789479936.425612:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789479936.433396:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8586:1876405551926016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479936.433492:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479936.433552:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479936.435651:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926016 00000100:00100000:0.0:1789479936.435668:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926016 00000100:00100000:0.0:1789479936.435731:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789479936.435742:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8586:x1876405551926016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479936.436401:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:8586:x1876405551926016:12345-0@lo:502:llog_process_th.0 Request processed in 659us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479936.436411:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789479936.436483:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8586:1876405551926016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479936.436532:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479936.436541:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479936.436549:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789479936.436556:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1789479936.437723:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479936.439834:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730368 00000100:00100000:3.0:1789479936.439847:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730368 00000100:00100000:3.0:1789479936.439910:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:3.0:1789479936.439920:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:5592:x1876405526730368:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479936.439940:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479936.439958:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f30d6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.439997:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.440009:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.440019:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789479936.440725:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730368:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 801us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.440733:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000020:01000000:3.0:1789479936.440781:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789479936.440809:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479936.440818:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.445129:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479936.447324:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789479936.447331:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22a4535800 from 4 10000000:01000000:3.0:1789479936.447338:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479936.447387:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.447401:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.447413:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479936.447451:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.447541:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.447594:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.449660:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479936.449702:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926144 00000100:00100000:3.0:1789479936.449713:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926144 00000100:00100000:3.0:1789479936.449764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730496 00000100:00100000:3.0:1789479936.449767:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730496 00000100:00100000:3.0:1789479936.449782:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789479936.449791:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551926144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479936.449808:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789479936.450342:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:1.0:1789479936.450353:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730496:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479936.450673:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730496:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.450681:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00010000:00010000:3.0:1789479936.452529:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd4fb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.452583:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.452599:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.452608:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789479936.452701:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2910us (5158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.452708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789479936.453300:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479936.453323:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479936.453333:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479936.453424:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479936.453464:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479936.453516:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c42b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.455408:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926272 00000100:00100000:3.0:1789479936.455422:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926272 00000100:00100000:3.0:1789479936.455481:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789479936.455490:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.455823:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.455831:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789479936.455890:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.455939:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.455985:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.456013:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.456029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926400 00000100:00100000:3.0:1789479936.456034:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926400 00000100:00100000:3.0:1789479936.456055:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789479936.456061:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.461940:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479936.461984:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730624 00000100:00100000:2.0:1789479936.461992:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730624 00000100:00100000:2.0:1789479936.462033:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:2.0:1789479936.462057:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730624:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.462242:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6178us (6255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.462251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789479936.462812:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:5592:x1876405526730624:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 767us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.462829:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:1.0:1789479936.474845:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479936.476712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479936.476770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730752 00000100:00100000:1.0:1789479936.476779:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730752 00000100:00100000:1.0:1789479936.476826:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:1.0:1789479936.476838:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:6127:x1876405526730752:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479936.477144:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:6127:x1876405526730752:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 309us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.477154:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:2.0:1789479936.478532:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8591:1876405551926528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479936.478619:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.478667:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34540 going to sleep for 11 seconds 00000100:00100000:1.0:1789479936.479716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926528 00000100:00100000:1.0:1789479936.479726:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926528 00000100:00100000:1.0:1789479936.479787:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789479936.479796:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:8591:x1876405551926528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479936.480363:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8591:1876405551926528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789479936.480402:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479936.480413:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479936.480416:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789479936.480422:0:8591:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22a4535800 00000020:00000080:2.0:1789479936.480425:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789479936.480518:0:8591:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8591:1876405551926656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479936.491833:0:8591:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.491891:0:8591:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4423c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479936.499901:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:8591:x1876405551926528:12345-0@lo:502:llog_process_th.0 Request processed in 20089us (21264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.499921:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789479936.499941:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479936.503456:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926656 00000100:00100000:0.0:1789479936.503472:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926656 00000100:00100000:0.0:1789479936.503532:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526730880 00000100:00100000:0.0:1789479936.503535:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526730880 00000100:00100000:0.0:1789479936.503556:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789479936.503578:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8591:x1876405551926656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479936.503876:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:8591:x1876405551926656:12345-0@lo:502:llog_process_th.0 Request processed in 310us (12052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479936.503885:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789479936.503929:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:0.0:1789479936.503938:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:6127:x1876405526730880:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789479936.504060:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:6127:x1876405526730880:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 123us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479936.504067:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:2.0:1789479936.505037:0:8591:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8591:1876405551926656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789479936.505447:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479936.505458:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479936.505461:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789479936.505467:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789479936.517696:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789479936.517734:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479936.517747:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.517761:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479936.517772:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789479936.517775:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22aea50800 from 4 10000000:01000000:3.0:1789479936.517778:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479936.517819:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.517837:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.517849:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479936.517877:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.517952:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.517996:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.518023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926784 00000100:00100000:3.0:1789479936.518031:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926784 00000100:00100000:3.0:1789479936.518078:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789479936.518086:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551926784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479936.518113:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479936.518127:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd509 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.518154:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd509 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.518165:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd509 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.518175:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4e00, rc 0) 00000100:00100000:3.0:1789479936.518228:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551926784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.518235:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789479936.518313:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479936.518326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479936.518335:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479936.518384:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.518409:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.518424:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.518437:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551926912 00000100:00100000:3.0:1789479936.518441:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551926912 00000100:00100000:3.0:1789479936.518464:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789479936.518470:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551926912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.518726:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551926912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.518734:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789479936.518763:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551926912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.518788:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551927040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.518826:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479936.518839:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479936.518851:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927040 00000100:00100000:3.0:1789479936.518854:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927040 00000100:00100000:3.0:1789479936.518876:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789479936.518882:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551927040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479936.519020:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551927040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479936.519033:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789479936.519071:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551927040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479936.522116:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8592:1876405551927168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479936.522213:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.522259:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4423c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479936.522364:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927168 00000100:00100000:1.0:1789479936.522372:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927168 00000100:00100000:1.0:1789479936.522420:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789479936.522430:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:8592:x1876405551927168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479936.522903:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:8592:x1876405551927168:12345-0@lo:502:llog_process_th.0 Request processed in 473us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.522919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789479936.523794:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8592:1876405551927168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789479936.523835:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479936.523847:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479936.523849:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789479936.523864:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22aea50800 00000020:00000080:2.0:1789479936.523867:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789479936.524244:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8592:1876405551927296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479936.524726:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.524805:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290dfa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789479936.525131:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927296 00000100:00100000:1.0:1789479936.525139:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927296 00000100:00100000:1.0:1789479936.525221:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789479936.525231:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:8592:x1876405551927296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479936.525517:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:8592:x1876405551927296:12345-0@lo:502:llog_process_th.0 Request processed in 286us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479936.525526:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789479936.525843:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:8592:1876405551927296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789479936.525983:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479936.525992:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479936.525994:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789479936.526000:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789479936.526215:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789479936.526235:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789479936.526247:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479936.526260:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479936.860357:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551927424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479936.860443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.860929:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927424 00000100:00100000:2.0:1789479936.861012:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927424 00000100:00100000:2.0:1789479936.861069:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789479936.861079:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551927424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479936.861119:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479936.861185:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551927424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.861193:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789479936.861261:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8fb80 x1876405551927424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479936.861302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551927424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479936.888326:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479936.888369:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479936.888401:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479936.888444:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731264 00000100:00100000:2.0:1789479936.888455:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731264 00000100:00100000:2.0:1789479936.888532:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731136 00000100:00100000:2.0:1789479936.888536:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731136 00000100:00100000:2.0:1789479936.888565:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789479936.888575:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479936.888658:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.888678:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789479936.888696:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789479936.888703:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526731136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479936.888730:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526731136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.888737:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00080000:2.0:1789479936.888873:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789479936.888879:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789479936.889978:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731008 00000100:00100000:0.0:1789479936.889987:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731008 00000100:00100000:0.0:1789479936.890047:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1789479936.890059:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526731008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479936.890119:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526731008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 64us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479936.890126:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:0.0:1789479936.890151:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789479937.053308:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479938.074966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479939.098507:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479940.123512:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479940.957831:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551927552:0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.957861:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551927680:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.963344:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551927808:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.965859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.967235:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551928064:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.967320:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479940.974210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479940.974235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927552 00000100:00100000:1.0:1789479940.974246:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927552 00000100:00100000:0.0:1789479940.974299:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551928192:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974320:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789479940.974332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551927552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.974349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479940.974390:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551927936:0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.974414:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479940.974468:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551927552:12345-0@lo:400:kworker.0 Request processed in 138us (8617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.974484:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789479940.974545:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551927552:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479940.974605:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928064 00000100:00100000:1.0:1789479940.974610:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928064 00000100:00100000:1.0:1789479940.974648:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927680 00000100:00100000:1.0:1789479940.974651:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927680 00000100:00100000:1.0:1789479940.974663:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927808 00000100:00100000:1.0:1789479940.974666:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927808 00000100:00100000:1.0:1789479940.974688:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479940.974694:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551928064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974746:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551928064:12345-0@lo:400:kworker.0 Request processed in 52us (7427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.974753:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479940.974764:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789479940.974769:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551927680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974800:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551927680:12345-0@lo:400:kworker.0 Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.974806:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789479940.974816:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789479940.974821:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551927808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974846:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551927808:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.974852:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789479940.974865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479940.974887:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551928064:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.974915:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551927680:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.975556:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551927808:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.985007:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928192 00000100:00100000:1.0:1789479940.985024:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928192 00000100:00100000:1.0:1789479940.985114:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551927936 00000100:00100000:1.0:1789479940.985118:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551927936 00000100:00100000:1.0:1789479940.985147:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479940.985157:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551928192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.985261:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551928192:12345-0@lo:400:kworker.0 Request processed in 105us (10911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.985268:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789479940.985299:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479940.985309:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551927936:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789479940.985333:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479940.985338:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789479940.985349:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551927936:12345-0@lo:400:kworker.0 Request processed in 43us (10934us total) trans 0 rc 0/0 00010000:00080000:1.0:1789479940.986575:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948700 x1876405551928192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479940.986591:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551928192:0@lo:400:kworker.0 00010000:00080000:1.0:1789479940.989004:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba94b100 x1876405551927936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479940.989025:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551927936:0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.994263:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789479941.146444:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479941.439180:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789479941.470458:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479941.470544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479941.472268:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928320 00000100:00100000:3.0:1789479941.472316:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928320 00000100:00100000:3.0:1789479941.472376:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789479941.472387:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789479941.472436:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479941.472842:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 456us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479941.472850:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789479941.472969:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac7800 x1876405551928320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479941.473066:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479941.978759:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479941.978789:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479941.978873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479941.979123:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928448 00000100:00100000:2.0:1789479941.979133:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928448 00000100:00100000:2.0:1789479941.979202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479941.979211:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479941.979250:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479941.979364:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479941.979372:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789479941.979583:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8c000 x1876405551928448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479941.979603:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479942.000421:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479942.000471:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479942.000508:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479942.000542:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479942.000729:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731776 00000100:00100000:2.0:1789479942.000740:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731776 00000100:00100000:2.0:1789479942.000804:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731648 00000100:00100000:2.0:1789479942.000808:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731648 00000100:00100000:2.0:1789479942.000832:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789479942.000841:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479942.000920:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479942.000939:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789479942.000957:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789479942.000963:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479942.000999:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526731648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479942.001005:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00080000:3.0:1789479942.001480:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479942.001487:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789479942.001634:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731392 00000100:00100000:0.0:1789479942.001640:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731392 00000100:00100000:0.0:1789479942.001692:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:0.0:1789479942.001699:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526731392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479942.001739:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526731392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479942.001745:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:1.0:1789479942.002448:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731520 00000100:00100000:1.0:1789479942.002455:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731520 00000100:00100000:1.0:1789479942.002510:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1789479942.002518:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526731520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479942.002564:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526731520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479942.002571:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00080000:3.0:1789479942.006244:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789479942.170596:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479943.195461:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479944.219732:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479945.242626:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479946.075569:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551928832:0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.075657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479946.075743:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479946.075757:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928960:0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.075788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.075901:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551928576:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.075946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.075981:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551929088:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.076006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479946.076018:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928832 00000100:00100000:1.0:1789479946.076029:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479946.076035:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551928704:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.076054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.076067:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551929216:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.076109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.076159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929088 00000100:00100000:1.0:1789479946.076164:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929088 00000100:00100000:2.0:1789479946.076216:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928832 00000100:00100000:1.0:1789479946.076240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928704 00000100:00100000:1.0:1789479946.076244:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928704 00000100:00100000:2.0:1789479946.076259:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789479946.076271:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551929088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.076594:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928576 00000100:00100000:0.0:1789479946.076600:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928576 00000100:00100000:0.0:1789479946.076633:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789479946.076640:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551928576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.081094:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789479946.081145:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551928832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.081447:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551928576:12345-0@lo:400:kworker.0 Request processed in 4803us (5496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479946.081461:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1789479946.081587:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479946.081604:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551929088:12345-0@lo:400:kworker.0 Request processed in 5330us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479946.081614:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551928960 00000100:00100000:2.0:1789479946.081617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789479946.081627:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551928960 00000100:00100000:2.0:1789479946.081676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789479946.081687:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551928704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.081690:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929216 00000100:00100000:0.0:1789479946.081696:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929216 00000100:00100000:0.0:1789479946.081723:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789479946.081734:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479946.081741:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551928704:12345-0@lo:400:kworker.0 Request processed in 56us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479946.081749:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789479946.081780:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789479946.081787:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551928960:12345-0@lo:400:kworker.0 Request processed in 55us (5996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479946.081793:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551929216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.081799:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789479946.081825:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479946.081828:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479946.081843:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551929216:12345-0@lo:400:kworker.0 Request processed in 55us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479946.081851:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789479946.081879:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948700 x1876405551928960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479946.081896:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551928960:0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.081957:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551928704:0@lo:400:kworker.0 00010000:00080000:0.0:1789479946.081971:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948e00 x1876405551929216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479946.081995:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551929216:0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.082009:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551928576:0@lo:400:kworker.0 00000100:00100000:0.0:1789479946.082021:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551929088:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.085394:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551928832:12345-0@lo:400:kworker.0 Request processed in 4267us (9720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479946.085692:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551928832:0@lo:400:kworker.0 00000100:00100000:1.0:1789479946.086358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1789479946.266630:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479946.589398:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479946.589426:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551929344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479946.589500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.589578:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929344 00000100:00100000:1.0:1789479946.589588:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929344 00000100:00100000:1.0:1789479946.589644:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479946.589652:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551929344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479946.589692:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479946.589755:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551929344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479946.589775:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789479946.589819:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac5f80 x1876405551929344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479946.589841:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551929344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479947.105430:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479947.113551:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551929472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479947.113665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479947.113822:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929472 00000100:00100000:1.0:1789479947.113832:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929472 00000100:00100000:1.0:1789479947.113917:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479947.113929:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551929472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789479947.113995:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479947.114060:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551929472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479947.114071:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789479947.119468:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8c380 x1876405551929472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479947.119507:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551929472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479947.129351:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479947.129413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479947.129463:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479947.129570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526731904 00000100:00100000:0.0:1789479947.129583:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526731904 00000100:00100000:0.0:1789479947.129660:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1789479947.129673:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526731904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479947.129768:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526731904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479947.129778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1789479947.129837:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732160 00000100:00100000:0.0:1789479947.129841:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732160 00000100:00100000:0.0:1789479947.129885:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789479947.129892:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2344:x1876405526732160:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:0.0:1789479947.129927:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd44c 00000100:00080000:0.0:1789479947.129939:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2283eaa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789479947.130004:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789479947.130477:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+2:2344:x1876405526732160:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 583us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479947.130485:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:0.0:1789479947.130642:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789479947.130697:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479947.131054:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479947.131933:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732032 00000100:00100000:2.0:1789479947.131946:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732032 00000100:00100000:2.0:1789479947.132084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1789479947.132096:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526732032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479947.132175:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526732032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 82us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479947.132182:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789479947.132398:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732288 00000100:00100000:3.0:1789479947.132404:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732288 00000100:00100000:3.0:1789479947.132449:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789479947.132458:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2344:x1876405526732288:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1789479947.132494:0:6686:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd453 00000100:00080000:3.0:1789479947.132505:0:6686:0:(import.c:65:import_set_state_nolock()) ffff8d2283ea8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789479947.132557:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1789479947.134338:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479947.134350:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479947.138640:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+2:2344:x1876405526732288:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 495us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479947.138667:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00010000:00010000:3.0:1789479947.138811:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479947.291433:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479948.314630:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789479948.588978:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing yml_node 00010000:00010000:0.0:1789479949.339445:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789479949.771234:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:3.0:1789479949.771257:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d2283eae800/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:3.0:1789479949.771321:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283eae800/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-OST0000 00000020:00000080:3.0:1789479949.771385:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2283eaa800 for lustre-OST0000 00010000:00010000:3.0:1789479950.363017:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789479950.830658:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:0.0:1789479950.830674:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d2283ea9000/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:2.0:1789479950.831072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283ea9000/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-OST0001 00000020:00000080:2.0:1789479950.832480:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2283ea8000 for lustre-OST0001 00000100:00100000:3.0:1789479951.195096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551929856:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.195198:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.195337:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479951.195344:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551929984:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.195377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.195472:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551929728:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195508:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.195541:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551930240:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.195593:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789479951.195600:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551929600:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.195656:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551930112:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195679:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.195723:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929856 00000100:00100000:1.0:1789479951.195735:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929856 00000100:00100000:1.0:1789479951.195810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929728 00000100:00100000:1.0:1789479951.195814:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929728 00000100:00100000:1.0:1789479951.195846:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930112 00000100:00100000:1.0:1789479951.195848:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930112 00000100:00100000:1.0:1789479951.195864:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479951.195873:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551929856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195930:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551929856:12345-0@lo:400:kworker.0 Request processed in 59us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.195938:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479951.195953:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479951.195959:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.195983:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551929728:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.195989:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479951.195998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479951.196003:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551930112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.196026:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551930112:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.196031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479951.196068:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551930112:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.196078:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551929728:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.196216:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551929856:0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.196848:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929984 00000100:00100000:0.0:1789479951.196855:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929984 00000100:00100000:0.0:1789479951.196907:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930240 00000100:00100000:0.0:1789479951.196910:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930240 00000100:00100000:0.0:1789479951.196941:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789479951.196949:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551929984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.197014:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551929984:12345-0@lo:400:kworker.0 Request processed in 66us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479951.197020:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789479951.197033:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789479951.197038:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551930240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.197067:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551930240:12345-0@lo:400:kworker.0 Request processed in 29us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479951.197072:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789479951.197092:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551929600 00000100:00100000:0.0:1789479951.197096:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551929600 00000100:00100000:0.0:1789479951.197118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789479951.197124:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551929600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.197153:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551929600:12345-0@lo:400:kworker.0 Request processed in 30us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479951.197176:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1789479951.197204:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479951.197208:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789479951.197211:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479951.197255:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551929600:0@lo:400:kworker.0 00010000:00080000:0.0:1789479951.197270:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8c000 x1876405551930240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479951.197309:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551930240:0@lo:400:kworker.0 00010000:00080000:0.0:1789479951.197343:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8d500 x1876405551929984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479951.197353:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551929984:0@lo:400:kworker.0 00010000:00010000:0.0:1789479951.386512:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479951.709829:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479951.709861:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551930368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479951.709958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.710118:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930368 00000100:00100000:1.0:1789479951.710128:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930368 00000100:00100000:1.0:1789479951.710200:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789479951.710222:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551930368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479951.710275:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479951.710362:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551930368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.710389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789479951.711086:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac4a80 x1876405551930368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479951.711112:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551930368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479952.223029:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479952.223063:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551930496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479952.223167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479952.223402:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930496 00000100:00100000:2.0:1789479952.223413:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930496 00000100:00100000:2.0:1789479952.223488:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789479952.223502:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551930496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479952.223564:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479952.223636:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551930496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479952.223645:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789479952.223997:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8d500 x1876405551930496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479952.224020:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551930496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479952.244594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479952.244669:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479952.245943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732544 00000100:00100000:2.0:1789479952.245960:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732544 00000100:00100000:2.0:1789479952.246086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789479952.246100:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526732544:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479952.246245:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526732544:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 147us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479952.246253:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00080000:0.0:1789479952.246387:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479952.247373:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732416 00000100:00100000:1.0:1789479952.247381:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732416 00000100:00100000:1.0:1789479952.247445:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:1.0:1789479952.247456:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526732416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479952.247537:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526732416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 84us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479952.247544:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00010000:00010000:3.0:1789479952.411559:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789479953.160836:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789479953.434401:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479954.458542:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479955.482551:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479956.121269:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:3.0:1789479956.316566:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551930752:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317184:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551931264:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317215:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317251:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789479956.317257:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551930624:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317312:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317336:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551931136:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317356:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317387:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551930880:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317430:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479956.317506:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931008:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.317534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.317568:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930752 00000100:00100000:3.0:1789479956.317577:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930752 00000100:00100000:3.0:1789479956.317629:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931136 00000100:00100000:3.0:1789479956.317641:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931136 00000100:00100000:3.0:1789479956.318399:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930880 00000100:00100000:3.0:1789479956.318405:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930880 00000100:00100000:3.0:1789479956.318426:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789479956.318797:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551930752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.318884:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551930752:12345-0@lo:400:kworker.0 Request processed in 450us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.318892:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789479956.318916:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479956.319830:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551931136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.319893:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551931136:12345-0@lo:400:kworker.0 Request processed in 971us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.319901:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479956.319997:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479956.320009:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551930880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320047:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551930880:12345-0@lo:400:kworker.0 Request processed in 42us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.320053:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479956.320080:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931264 00000100:00100000:3.0:1789479956.320087:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931264 00000100:00100000:3.0:1789479956.320135:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931008 00000100:00100000:3.0:1789479956.320139:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931008 00000100:00100000:3.0:1789479956.320160:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479956.320165:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551931264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320194:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551931264:12345-0@lo:400:kworker.0 Request processed in 29us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.320199:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479956.320226:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789479956.320231:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320258:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931008:12345-0@lo:400:kworker.0 Request processed in 28us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.320263:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789479956.320299:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551930624 00000100:00100000:3.0:1789479956.320303:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551930624 00000100:00100000:3.0:1789479956.320329:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789479956.320334:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551930624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320363:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551930624:12345-0@lo:400:kworker.0 Request processed in 29us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.320369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:3.0:1789479956.320415:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479956.320420:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479956.320423:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789479956.320485:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd93b80 x1876405551931008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479956.320504:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931008:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320516:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551930880:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320550:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551930624:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320560:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551931136:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.320571:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551930752:0@lo:400:kworker.0 00010000:00080000:3.0:1789479956.320582:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4974000 x1876405551931264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479956.320604:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551931264:0@lo:400:kworker.0 00010000:00010000:3.0:1789479956.507033:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479956.831088:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479956.831199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479956.831734:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931392 00000100:00100000:2.0:1789479956.831745:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931392 00000100:00100000:2.0:1789479956.831816:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789479956.831827:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479956.831881:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479956.832069:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479956.832078:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789479956.832126:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac6300 x1876405551931392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479956.832168:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479957.338739:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479957.338768:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479957.338880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479957.338966:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931520 00000100:00100000:2.0:1789479957.338976:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931520 00000100:00100000:2.0:1789479957.339039:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789479957.339051:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479957.339115:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479957.339169:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551931520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479957.339175:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789479957.339227:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8c000 x1876405551931520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479957.339779:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551931520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479957.363143:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479957.363225:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479957.363346:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732672 00000100:00100000:1.0:1789479957.363359:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732672 00000100:00100000:1.0:1789479957.363419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:1.0:1789479957.363431:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2345:x1876405526732672:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479957.363522:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2345:x1876405526732672:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479957.363530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:2.0:1789479957.363933:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732800 00000100:00100000:2.0:1789479957.363940:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732800 00000100:00100000:2.0:1789479957.364000:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789479957.364008:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526732800:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479957.364055:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526732800:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 48us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479957.364062:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00080000:1.0:1789479957.364773:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789479957.530515:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479958.555741:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479959.011573:0:9441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789479959.581308:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479960.603793:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789479960.812911:0:9489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 09:45:59 EDT 2026 00000100:00100000:0.0:1789479961.437928:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551932032:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.438030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.438118:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479961.438125:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551931904:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.438180:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.438225:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932032 00000100:00100000:0.0:1789479961.438235:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932032 00000100:00100000:0.0:1789479961.438330:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789479961.438342:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551932032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.438409:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551932032:12345-0@lo:400:kworker.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.438418:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789479961.438445:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931904 00000100:00100000:0.0:1789479961.438450:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931904 00000100:00100000:0.0:1789479961.438481:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479961.438488:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551931904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.438519:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551931904:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.438526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479961.438597:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551931904:0@lo:400:kworker.0 00010000:00080000:0.0:1789479961.438612:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ddc00 x1876405551932032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479961.438638:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551932032:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439008:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551931776:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479961.439096:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551932288:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479961.439156:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789479961.439163:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551931648:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479961.439218:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551932160:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439239:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479961.439267:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931648 00000100:00100000:3.0:1789479961.439272:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931648 00000100:00100000:3.0:1789479961.439328:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789479961.439336:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439375:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551931648:12345-0@lo:400:kworker.0 Request processed in 39us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479961.439381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789479961.439416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551931776 00000100:00100000:3.0:1789479961.439420:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551931776 00000100:00100000:3.0:1789479961.439439:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932160 00000100:00100000:3.0:1789479961.439451:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932160 00000100:00100000:3.0:1789479961.439475:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789479961.439481:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551931776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439511:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551931776:12345-0@lo:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479961.439516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789479961.439529:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789479961.439548:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551932160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439575:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551932160:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479961.439581:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789479961.439624:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551931648:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439634:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551932160:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.439643:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551931776:0@lo:400:kworker.0 00000100:00080000:1.0:1789479961.440123:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789479961.440130:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479961.440200:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932288 00000100:00100000:0.0:1789479961.440206:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932288 00000100:00100000:0.0:1789479961.440258:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479961.440266:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551932288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.440348:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551932288:12345-0@lo:400:kworker.0 Request processed in 83us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.440355:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789479961.440444:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ddf80 x1876405551932288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.440458:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551932288:0@lo:400:kworker.0 00000100:00080000:1.0:1789479961.440511:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789479961.627454:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479961.946811:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551932416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479961.946926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.947557:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932416 00000100:00100000:1.0:1789479961.947568:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932416 00000100:00100000:1.0:1789479961.947655:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789479961.947667:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551932416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479961.947715:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479961.947805:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551932416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479961.947814:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789479961.949942:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac7800 x1876405551932416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.949995:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551932416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479962.458517:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551932544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479962.458617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479962.458760:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932544 00000100:00100000:2.0:1789479962.458782:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932544 00000100:00100000:2.0:1789479962.458857:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479962.458870:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551932544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479962.458919:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479962.458988:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551932544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479962.458995:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789479962.459055:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd8c000 x1876405551932544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479962.459080:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551932544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479962.484725:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479962.484800:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479962.485017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733056 00000100:00100000:2.0:1789479962.485031:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733056 00000100:00100000:2.0:1789479962.485126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1789479962.485138:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733056:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479962.485254:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733056:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479962.485263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789479962.485801:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526732928 00000100:00100000:1.0:1789479962.485808:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526732928 00000100:00100000:1.0:1789479962.485857:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:1.0:1789479962.485864:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526732928:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479962.485911:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526732928:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479962.485917:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00080000:0.0:1789479962.487113:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789479962.661880:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479963.674442:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479964.698638:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479965.743433:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479966.556624:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551933056:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.556726:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.556813:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479966.556822:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551932928:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.556841:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551932800:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.556857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.556900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.556909:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933056 00000100:00100000:1.0:1789479966.556932:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933056 00000100:00100000:1.0:1789479966.557007:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789479966.557018:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551933056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.557052:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551933312:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557086:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551933056:12345-0@lo:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.557096:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479966.557107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.557120:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933312 00000100:00100000:1.0:1789479966.557125:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933312 00000100:00100000:1.0:1789479966.557160:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789479966.557167:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551933312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.557180:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789479966.557203:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551932672:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557203:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551933312:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.557220:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789479966.557243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932928 00000100:00100000:1.0:1789479966.557247:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932928 00000100:00100000:1.0:1789479966.557276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932800 00000100:00100000:1.0:1789479966.557311:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932800 00000100:00100000:1.0:1789479966.557337:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479966.557344:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551932928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557378:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551932928:12345-0@lo:400:kworker.0 Request processed in 35us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.557384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479966.557397:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789479966.557403:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551932800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557430:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551932800:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.557436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789479966.557454:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789479966.557460:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479966.557463:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479966.557491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.557515:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551932928:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.557523:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551933184:0@lo:400:kworker.0 00010000:00080000:1.0:1789479966.557534:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aeac7800 x1876405551933056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479966.557546:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551933056:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.557552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.557601:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551932800:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557606:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933184 00000100:00100000:1.0:1789479966.557611:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933184 00010000:00080000:2.0:1789479966.557628:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e0a80 x1876405551933312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.557639:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551933312:0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.557645:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789479966.557653:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.557691:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551932672 00000100:00100000:2.0:1789479966.557700:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551932672 00000100:00100000:1.0:1789479966.557705:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551933184:12345-0@lo:400:kworker.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.557715:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789479966.557739:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479966.558346:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551933184:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.558581:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789479966.558591:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551932672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.558707:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551932672:12345-0@lo:400:kworker.0 Request processed in 118us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.558713:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789479966.561778:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551932672:0@lo:400:kworker.0 00010000:00010000:2.0:1789479966.747219:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479967.066653:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551933440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479967.066758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479967.066820:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933440 00000100:00100000:2.0:1789479967.066836:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933440 00000100:00100000:2.0:1789479967.066973:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479967.066986:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551933440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479967.067031:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789479967.067131:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551933440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479967.067157:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789479967.067782:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e0700 x1876405551933440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479967.067811:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551933440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479967.584198:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551933568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479967.584353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479967.587108:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933568 00000100:00100000:3.0:1789479967.587123:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933568 00000100:00100000:3.0:1789479967.587308:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789479967.587319:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551933568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479967.587360:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479967.587445:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551933568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (3092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479967.587453:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789479967.590230:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485dc00 x1876405551933568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479967.590260:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551933568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479967.607113:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479967.607172:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479967.607249:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733312 00000100:00100000:1.0:1789479967.607260:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733312 00000100:00100000:1.0:1789479967.607374:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789479967.607385:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526733312:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479967.607473:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526733312:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479967.607481:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1789479967.607659:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733184 00000100:00100000:2.0:1789479967.607663:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733184 00000100:00100000:2.0:1789479967.607700:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:2.0:1789479967.607707:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526733184:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479967.607743:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2347:x1876405526733184:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479967.607749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00080000:3.0:1789479967.608057:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789479967.770856:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479968.794521:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479969.823841:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479970.843076:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479971.675706:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551933824:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.675794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.675860:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551934336:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.675888:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.675922:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789479971.675928:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551933696:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.675960:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.675980:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551934208:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676003:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.676031:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551933952:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676053:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.676073:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479971.676079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551934080:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.676131:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933824 00000100:00100000:3.0:1789479971.676139:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933824 00000100:00100000:3.0:1789479971.676179:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934208 00000100:00100000:3.0:1789479971.676194:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934208 00000100:00100000:3.0:1789479971.676221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933952 00000100:00100000:3.0:1789479971.676319:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933952 00000100:00100000:3.0:1789479971.676450:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479971.676458:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551933824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676512:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551933824:12345-0@lo:400:kworker.0 Request processed in 55us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676520:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479971.676543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479971.676549:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551934208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676577:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551934208:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676583:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479971.676595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789479971.676600:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551933952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676631:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551933952:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789479971.676661:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934336 00000100:00100000:3.0:1789479971.676666:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934336 00000100:00100000:3.0:1789479971.676693:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934080 00000100:00100000:3.0:1789479971.676697:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934080 00000100:00100000:3.0:1789479971.676717:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789479971.676723:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551934336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676754:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551934336:12345-0@lo:400:kworker.0 Request processed in 31us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676761:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789479971.676782:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479971.676788:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551934080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676843:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551934080:12345-0@lo:400:kworker.0 Request processed in 54us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676850:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479971.676870:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551933696 00000100:00100000:3.0:1789479971.676874:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551933696 00000100:00100000:3.0:1789479971.676899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789479971.676905:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551933696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.676934:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551933696:12345-0@lo:400:kworker.0 Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.676940:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1789479971.676978:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479971.676982:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479971.676984:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789479971.677020:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4976680 x1876405551934080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479971.677034:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551934080:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.677046:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551933952:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.677076:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551933696:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.677086:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551934208:0@lo:400:kworker.0 00000100:00100000:3.0:1789479971.677095:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551933824:0@lo:400:kworker.0 00010000:00080000:3.0:1789479971.677103:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4975500 x1876405551934336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479971.677126:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551934336:0@lo:400:kworker.0 00010000:00010000:2.0:1789479971.868518:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479972.191836:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479972.191866:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551934464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479972.191952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479972.192074:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934464 00000100:00100000:1.0:1789479972.192084:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934464 00000100:00100000:1.0:1789479972.192141:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479972.192152:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551934464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479972.192190:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479972.192237:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551934464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479972.192244:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789479972.192338:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e3480 x1876405551934464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479972.192357:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551934464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479972.698464:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479972.698490:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479972.698572:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479972.698656:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934592 00000100:00100000:0.0:1789479972.698670:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934592 00000100:00100000:0.0:1789479972.698729:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479972.698739:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551934592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479972.698779:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479972.699218:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551934592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 480us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479972.699227:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789479972.699257:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485ca80 x1876405551934592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479972.699278:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479972.727364:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479972.727424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479972.727639:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733568 00000100:00100000:3.0:1789479972.727651:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733568 00000100:00100000:3.0:1789479972.727734:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789479972.727746:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479972.727851:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479972.727871:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1789479972.728184:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733440 00000100:00100000:2.0:1789479972.728189:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733440 00000100:00100000:2.0:1789479972.728223:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1789479972.728230:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526733440:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479972.728263:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526733440:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479972.728296:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00080000:0.0:1789479972.729136:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789479972.893226:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479973.915683:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479974.938580:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479975.965173:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479976.795140:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551935104:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.795250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.795344:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479976.795350:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551934976:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.795379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.795416:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935104 00000100:00100000:2.0:1789479976.795424:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935104 00000100:00100000:2.0:1789479976.795480:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789479976.795489:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.795764:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551935104:12345-0@lo:400:kworker.0 Request processed in 276us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.795772:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789479976.795794:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479976.795824:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7dc00 x1876405551935104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479976.795838:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551935104:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.795991:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551934848:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.796052:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551935360:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.796109:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789479976.796116:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551934720:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796144:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.796165:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551935232:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.796227:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934976 00000100:00100000:3.0:1789479976.796232:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934976 00000100:00100000:3.0:1789479976.796267:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934848 00000100:00100000:3.0:1789479976.796271:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934848 00000100:00100000:3.0:1789479976.796305:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935232 00000100:00100000:3.0:1789479976.796308:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935232 00000100:00100000:3.0:1789479976.796324:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789479976.796330:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551934976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796368:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551934976:12345-0@lo:400:kworker.0 Request processed in 38us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.796375:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789479976.796393:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789479976.796399:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551934848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.796428:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551934848:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.796433:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789479976.796445:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789479976.796451:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551935232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.796691:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551934720 00000100:00100000:1.0:1789479976.796696:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551934720 00000100:00100000:1.0:1789479976.796740:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789479976.796747:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551934720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.796794:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551934720:12345-0@lo:400:kworker.0 Request processed in 47us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479976.796799:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789479976.796826:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935360 00000100:00100000:1.0:1789479976.796829:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935360 00000100:00100000:1.0:1789479976.796855:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789479976.796862:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551935360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.796891:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551935360:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479976.796898:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789479976.796926:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479976.796930:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479976.796955:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551934720:0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.796965:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551934848:0@lo:400:kworker.0 00010000:00080000:1.0:1789479976.796993:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7c000 x1876405551935360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479976.797004:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551935360:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.797180:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551935232:12345-0@lo:400:kworker.0 Request processed in 729us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.797188:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789479976.797762:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551934976:0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.797839:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551935232:0@lo:400:kworker.0 00010000:00010000:3.0:1789479976.986467:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479977.306599:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479977.306626:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551935488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479977.306703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479977.306865:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935488 00000100:00100000:0.0:1789479977.306875:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935488 00000100:00100000:0.0:1789479977.306933:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789479977.306944:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551935488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789479977.307007:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479977.307058:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551935488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479977.307065:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789479977.309917:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e0e00 x1876405551935488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479977.309953:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551935488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479977.818592:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479977.818622:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551935616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479977.818725:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479977.818927:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935616 00000100:00100000:0.0:1789479977.818937:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935616 00000100:00100000:0.0:1789479977.818999:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789479977.819008:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551935616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479977.819050:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479977.819110:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551935616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479977.819117:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789479977.819322:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485fb80 x1876405551935616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479977.819360:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551935616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479977.841168:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479977.841219:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479977.841310:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733824 00000100:00100000:1.0:1789479977.841320:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733824 00000100:00100000:1.0:1789479977.841402:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1789479977.841428:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733824:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479977.841515:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526733824:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479977.841522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00080000:2.0:1789479977.841772:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479977.845144:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733696 00000100:00100000:3.0:1789479977.845158:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733696 00000100:00100000:3.0:1789479977.845224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:3.0:1789479977.845233:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526733696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479977.845362:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526733696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 129us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479977.845369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00010000:00010000:2.0:1789479978.010813:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479979.040809:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479979.586976:0:10120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:46:18 (1789479978) === 00010000:00010000:2.0:1789479980.058720:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479980.301697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479980.312719:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526733952 00000100:00100000:2.0:1789479980.312740:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526733952 00000100:00100000:2.0:1789479980.312870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:2.0:1789479980.312884:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:8122:x1876405526733952:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789479980.312908:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479980.312935:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffe200/0xbb972366037fd517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f30dd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479980.312985:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe200/0xbb972366037fd517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30dd expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479980.312999:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffe200/0xbb972366037fd517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30dd expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479980.313010:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe200, rc 0) 00000100:00100000:2.0:1789479980.313116:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526733952:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 235us (11435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479980.313123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:1.0:1789479980.324182:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.331389:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734080 00000100:00100000:3.0:1789479980.331414:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734080 00000100:00100000:3.0:1789479980.331520:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:3.0:1789479980.331534:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526734080:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789479980.332338:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526734080:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 800us (8165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.332349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:0.0:1789479980.338958:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.339331:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734208 00000100:00100000:3.0:1789479980.339346:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734208 00000100:00100000:3.0:1789479980.339504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:3.0:1789479980.339517:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526734208:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789479980.339847:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526734208:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 333us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.339856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:0.0:1789479980.360142:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.360348:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734336 00000100:00100000:3.0:1789479980.360361:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734336 00000100:00100000:3.0:1789479980.360441:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:3.0:1789479980.360454:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8126:x1876405526734336:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789479980.360963:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8126:x1876405526734336:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 509us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.360973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:1.0:1789479980.368819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479980.368944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734464 00000100:00100000:2.0:1789479980.368959:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734464 00000100:00100000:2.0:1789479980.369034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1789479980.369046:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8126:x1876405526734464:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789479980.371550:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8126:x1876405526734464:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 2485us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479980.371571:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1789479980.402470:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479980.403506:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734592 00000100:00100000:0.0:1789479980.403523:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734592 00000100:00100000:0.0:1789479980.403739:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1789479980.403753:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:8122:x1876405526734592:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789479980.403777:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479980.403811:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280030c00/0xbb972366037fd51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3107 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479980.403855:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030c00/0xbb972366037fd51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3107 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479980.403868:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280030c00/0xbb972366037fd51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3107 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479980.403879:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280030c00, rc 0) 00000100:00100000:0.0:1789479980.403962:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:8122:x1876405526734592:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 211us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479980.403978:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1789479980.427200:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479980.431412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734720 00000100:00100000:2.0:1789479980.431433:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734720 00000100:00100000:2.0:1789479980.431600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:2.0:1789479980.431628:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:8122:x1876405526734720:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789479980.431673:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789479980.431693:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789479980.431698:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789479980.431701:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789479980.431704:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789479980.438876:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:8122:x1876405526734720:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 7237us (11675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479980.438892:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:0.0:1789479980.452234:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.452806:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734848 00000100:00100000:3.0:1789479980.452816:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734848 00000100:00100000:3.0:1789479980.452874:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:3.0:1789479980.452883:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:8122:x1876405526734848:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789479980.452901:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479980.452918:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f310e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479980.452944:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479980.452956:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479980.452965:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4a00, rc 0) 00000100:00100000:3.0:1789479980.453029:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8122:x1876405526734848:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 148us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.453035:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:0.0:1789479980.457861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479980.457969:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526734976 00000100:00100000:2.0:1789479980.457980:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526734976 00000100:00100000:2.0:1789479980.458040:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:2.0:1789479980.458051:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8122:x1876405526734976:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789479980.459494:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8122:x1876405526734976:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1436us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479980.459506:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1789479980.463039:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.463118:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735104 00000100:00100000:1.0:1789479980.463127:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735104 00000100:00100000:1.0:1789479980.463188:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:1.0:1789479980.463198:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8122:x1876405526735104:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789479980.463941:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8122:x1876405526735104:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 740us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.463951:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:0.0:1789479980.472474:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479980.472694:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735232 00000100:00100000:2.0:1789479980.472708:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735232 00000100:00100000:2.0:1789479980.472819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1789479980.472830:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8130:x1876405526735232:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789479980.473106:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8130:x1876405526735232:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 277us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479980.473115:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1789479980.481209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.481379:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735360 00000100:00100000:1.0:1789479980.481391:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735360 00000100:00100000:1.0:1789479980.481448:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1789479980.481458:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8130:x1876405526735360:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479980.481879:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:8130:x1876405526735360:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 421us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.481887:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:0.0:1789479980.501043:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.502204:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735488 00000100:00100000:1.0:1789479980.502216:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735488 00000100:00100000:1.0:1789479980.502316:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789479980.502325:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1876405526735488:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789479980.502360:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4b6ec658-f7f1-408f-9531-0dbaf67922ea@192.168.204.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1789479980.502428:0:5832:0:(genops.c:1384:class_connect()) connect: client 4b6ec658-f7f1-408f-9531-0dbaf67922ea, cookie 0xbb972366037fd52c 00000004:00100000:1.0:1789479980.502459:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789479980.503048:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479980.503263:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2344:x1876405526735488:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 937us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.503272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789479980.511005:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.511384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735872 00000100:00100000:1.0:1789479980.511394:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735872 00000100:00100000:1.0:1789479980.511463:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1789479980.511473:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526735872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479980.511555:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526735872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 84us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.511563:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:2.0:1789479980.511719:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479980.524933:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.525334:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.525624:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735616 00000100:00100000:3.0:1789479980.525659:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735616 00000100:00100000:3.0:1789479980.525731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526735744 00000100:00100000:3.0:1789479980.525734:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526735744 00000100:00100000:3.0:1789479980.525760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789479980.525770:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+7:0:x1876405526735616:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789479980.525865:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789479980.525970:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+7:0:x1876405526735616:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 201us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.525978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789479980.526002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789479980.526009:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526735744:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789479980.526019:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789479980.526040:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526735744:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479980.526046:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:2.0:1789479980.526112:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479980.528980:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.529091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736000 00000100:00100000:1.0:1789479980.529101:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736000 00000100:00100000:1.0:1789479980.529162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789479980.529173:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526736000:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789479980.529312:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526736000:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.529319:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789479980.533580:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.533749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736384 00000100:00100000:1.0:1789479980.533760:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736384 00000100:00100000:1.0:1789479980.533824:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789479980.533835:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526736384:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789479980.533945:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789479980.533954:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479980.534010:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479980.534104:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:8122:x1876405526736384:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 270us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.534112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789479980.534138:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736128 00000100:00100000:1.0:1789479980.534142:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736128 00000100:00100000:1.0:1789479980.534161:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736256 00000100:00100000:1.0:1789479980.534163:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736256 00000100:00100000:1.0:1789479980.534178:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789479980.534183:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1876405526736128:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789479980.534206:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4b6ec658-f7f1-408f-9531-0dbaf67922ea@192.168.204.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1789479980.534244:0:6685:0:(genops.c:1384:class_connect()) connect: client 4b6ec658-f7f1-408f-9531-0dbaf67922ea, cookie 0xbb972366037fd533 00002000:00100000:1.0:1789479980.534256:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b6ec658-f7f1-408f-9531-0dbaf67922ea/ffff8d229c50d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789479980.534310:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789479980.535847:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789479980.535904:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d229c50a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479980.536049:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789479980.536059:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1876405526736256:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789479980.536087:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4b6ec658-f7f1-408f-9531-0dbaf67922ea@192.168.204.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1789479980.536123:0:6687:0:(genops.c:1384:class_connect()) connect: client 4b6ec658-f7f1-408f-9531-0dbaf67922ea, cookie 0xbb972366037fd53a 00002000:00100000:0.0:1789479980.536134:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b6ec658-f7f1-408f-9531-0dbaf67922ea/ffff8d22bb592800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789479980.536159:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789479980.536364:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789479980.536395:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d22bb591000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479980.540230:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2344:x1876405526736128:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 6030us (6261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479980.540247:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789479980.540598:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2344:x1876405526736256:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 4536us (6584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479980.540607:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:3.0:1789479981.091141:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789479981.469159:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000001:00100000:3.0:1789479981.479392:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000100:00100000:3.0:1789479981.917809:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551936000:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.917897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.917966:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479981.917973:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551936128:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.918000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.918039:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936128 00000100:00100000:3.0:1789479981.918054:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936128 00000100:00100000:3.0:1789479981.918113:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479981.918121:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551936128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.918169:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551936128:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.918176:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789479981.918205:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479981.918206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936000 00000100:00100000:0.0:1789479981.918213:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936000 00010000:00080000:3.0:1789479981.918242:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec0e00 x1876405551936128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479981.918257:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789479981.918258:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551936128:0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.918269:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551936000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.918343:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551936000:12345-0@lo:400:kworker.0 Request processed in 78us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479981.918351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789479981.918367:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551936000:0@lo:400:kworker.0 00000100:00080000:0.0:1789479981.918375:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479981.919901:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551935744:0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.919970:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479981.920026:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551936256:0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479981.920078:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479981.920085:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551935872:0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920122:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479981.920146:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551936384:0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479981.920222:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936256 00000100:00100000:1.0:1789479981.920229:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936256 00000100:00100000:1.0:1789479981.920278:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935872 00000100:00100000:1.0:1789479981.920303:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935872 00000100:00100000:1.0:1789479981.920323:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789479981.920332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551936256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920379:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551936256:12345-0@lo:400:kworker.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479981.920386:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789479981.920403:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789479981.920410:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551935872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920437:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551935872:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479981.920442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789479981.920468:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936384 00000100:00100000:1.0:1789479981.920471:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936384 00000100:00100000:1.0:1789479981.920498:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789479981.920504:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551936384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920533:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551936384:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479981.920539:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789479981.920559:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479981.920564:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479981.920593:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551935872:0@lo:400:kworker.0 00010000:00080000:1.0:1789479981.920615:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec3100 x1876405551936384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479981.920825:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551936384:0@lo:400:kworker.0 00000100:00100000:1.0:1789479981.920841:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551936256:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.920927:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551935744 00000100:00100000:3.0:1789479981.920932:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551935744 00000100:00100000:3.0:1789479981.920973:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789479981.920981:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551935744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.921032:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551935744:12345-0@lo:400:kworker.0 Request processed in 53us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.921038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789479981.921133:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551935744:0@lo:400:kworker.0 00010000:00010000:2.0:1789479982.108840:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479982.433398:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479982.433429:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551936512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479982.433512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479982.433746:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936512 00000100:00100000:1.0:1789479982.433755:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936512 00000100:00100000:1.0:1789479982.433814:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479982.433824:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551936512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479982.433860:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479982.433907:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551936512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479982.433915:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789479982.433999:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e3800 x1876405551936512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479982.434022:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551936512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479982.938555:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551936640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479982.938642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479982.938807:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936640 00000100:00100000:0.0:1789479982.938816:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936640 00000100:00100000:0.0:1789479982.938876:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789479982.938893:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551936640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479982.938933:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479982.938988:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551936640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479982.938995:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789479982.939108:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485ce00 x1876405551936640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479982.939128:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551936640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789479983.131343:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479984.156724:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479985.180237:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789479985.612528:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000100:00100000:0.0:1789479986.035672:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479986.035724:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479986.035821:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736512 00000100:00100000:3.0:1789479986.035834:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736512 00000100:00100000:3.0:1789479986.035910:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1789479986.035922:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526736512:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479986.036016:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526736512:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.036043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:2.0:1789479986.038686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479986.038730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789479986.038795:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736896 00000100:00100000:3.0:1789479986.038808:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736896 00000100:00100000:3.0:1789479986.038907:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1789479986.038921:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526736896:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479986.039020:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526736896:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.039028:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00080000:0.0:1789479986.039660:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479986.044746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789479986.045004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736640 00000100:00100000:1.0:1789479986.045019:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736640 00000100:00100000:1.0:1789479986.045133:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526736768 00000100:00100000:1.0:1789479986.045137:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526736768 00000100:00100000:1.0:1789479986.045177:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1789479986.045188:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526736640:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479986.045328:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526736640:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 142us (9602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.045337:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1789479986.045356:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789479986.045363:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526736768:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789479986.045385:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526736768:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.045404:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1789479986.046143:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737024 00000100:00100000:3.0:1789479986.046152:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737024 00000100:00100000:3.0:1789479986.046245:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789479986.046255:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479986.046339:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.046346:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00080000:2.0:1789479986.047558:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479986.047578:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789479986.207516:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479987.035023:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551937152:0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.035128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479987.035194:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479987.035200:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551937024:0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.035232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479987.035265:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937152 00000100:00100000:3.0:1789479987.035273:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937152 00000100:00100000:3.0:1789479987.035349:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789479987.035358:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bad17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551937152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.035410:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bad17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551937152:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479987.035432:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789479987.035608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937024 00000100:00100000:3.0:1789479987.035613:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937024 00000100:00100000:3.0:1789479987.035645:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789479987.035652:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551937024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.035683:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551937024:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479987.035689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789479987.035708:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479987.035713:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479987.035747:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551937024:0@lo:400:kworker.0 00010000:00080000:3.0:1789479987.035762:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec0000 x1876405551937152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479987.035771:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551937152:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551936896:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479987.036092:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551937408:0@lo:400:kworker.0 00000100:00100000:2.0:1789479987.036108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936896 00000100:00100000:2.0:1789479987.036113:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936896 00000100:00100000:1.0:1789479987.036114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479987.036143:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789479987.036145:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789479987.036150:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551936896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036152:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551936768:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479987.036183:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551936896:12345-0@lo:400:kworker.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479987.036190:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789479987.036199:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551937280:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036234:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479987.036266:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551936896:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036308:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551936768 00000100:00100000:1.0:1789479987.036312:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551936768 00000100:00100000:1.0:1789479987.036337:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789479987.036344:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551936768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479987.036348:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937280 00000100:00100000:2.0:1789479987.036351:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937280 00000100:00100000:2.0:1789479987.036375:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789479987.036377:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551936768:12345-0@lo:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479987.036381:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551937280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036391:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789479987.036410:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551937280:12345-0@lo:400:kworker.0 Request processed in 29us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479987.036416:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789479987.036421:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551936768:0@lo:400:kworker.0 00000100:00100000:1.0:1789479987.036430:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551937280:0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.036788:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937408 00000100:00100000:3.0:1789479987.036792:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937408 00000100:00100000:3.0:1789479987.036832:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789479987.036839:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479987.036886:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551937408:12345-0@lo:400:kworker.0 Request processed in 47us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479987.036892:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789479987.036916:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479987.036919:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789479987.036979:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec1f80 x1876405551937408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479987.036989:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551937408:0@lo:400:kworker.0 00010000:00010000:1.0:1789479987.228136:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479987.238078:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789479987.546853:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551937536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479987.546931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479987.547008:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937536 00000100:00100000:0.0:1789479987.547018:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937536 00000100:00100000:0.0:1789479987.547080:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789479987.547104:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551937536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789479987.547142:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479987.547195:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551937536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479987.547203:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789479987.547319:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e1880 x1876405551937536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479987.547341:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551937536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479988.058613:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551937664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479988.058715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479988.058840:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937664 00000100:00100000:0.0:1789479988.058849:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937664 00000100:00100000:0.0:1789479988.058907:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789479988.058926:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551937664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479988.058964:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479988.059017:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551937664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479988.059033:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789479988.059124:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485f100 x1876405551937664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479988.059146:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551937664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789479988.250526:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479989.280268:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479990.299592:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479991.158675:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479991.158741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479991.158784:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479991.158815:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479991.158846:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789479991.158884:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737536 00000100:00100000:2.0:1789479991.158897:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737536 00000100:00100000:0.0:1789479991.159229:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737152 00000100:00100000:0.0:1789479991.159234:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737152 00000100:00100000:0.0:1789479991.159325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1789479991.159341:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2345:x1876405526737152:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479991.159472:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2345:x1876405526737152:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 135us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479991.159482:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:3.0:1789479991.160087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737280 00000100:00100000:3.0:1789479991.160095:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737280 00000100:00100000:3.0:1789479991.160136:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737408 00000100:00100000:3.0:1789479991.160140:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737408 00000100:00100000:3.0:1789479991.160165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789479991.160174:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526737280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479991.160226:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526737280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479991.160233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789479991.160254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1789479991.160262:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789479991.160317:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 57us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479991.160324:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1789479991.160802:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737664 00000100:00100000:2.0:1789479991.160808:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737664 00000100:00100000:2.0:1789479991.160847:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789479991.160855:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526737536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479991.160901:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526737536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479991.160908:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789479991.160925:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789479991.160932:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737664:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789479991.163796:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526737664:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2848us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479991.163816:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00080000:2.0:1789479991.163894:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479991.163903:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479991.163906:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789479991.322744:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479992.157802:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551937792:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.157921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479992.157994:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551938304:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.158027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479992.158063:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789479992.158070:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551937920:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.158097:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479992.158117:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551938432:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.158145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479992.158186:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938304 00000100:00100000:0.0:1789479992.158198:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938304 00000100:00100000:0.0:1789479992.158267:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937920 00000100:00100000:0.0:1789479992.158271:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937920 00000100:00100000:0.0:1789479992.158345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789479992.158356:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551938304:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789479992.158901:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479992.158920:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938432 00000100:00100000:1.0:1789479992.158936:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938432 00000100:00100000:1.0:1789479992.158985:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789479992.158996:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551938432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479992.159074:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551938432:12345-0@lo:400:kworker.0 Request processed in 80us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479992.159093:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789479992.159125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789479992.159132:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551937920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.159136:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551938304:12345-0@lo:400:kworker.0 Request processed in 782us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479992.159164:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551937920:12345-0@lo:400:kworker.0 Request processed in 33us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479992.159164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789479992.159169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789479992.159182:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789479992.159220:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551937920:0@lo:400:kworker.0 00010000:00080000:0.0:1789479992.159236:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd785c00 x1876405551938432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479992.159247:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551938432:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.159257:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551938304:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.159567:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551937792 00000100:00100000:2.0:1789479992.159574:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551937792 00000100:00100000:2.0:1789479992.159611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789479992.159619:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551937792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.159689:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551937792:12345-0@lo:400:kworker.0 Request processed in 70us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.159695:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789479992.159857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551938048:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.159899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.159937:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479992.159945:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551938176:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.159969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479992.160109:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938176 00000100:00100000:2.0:1789479992.160113:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938176 00000100:00100000:1.0:1789479992.160121:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551937792:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.160160:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789479992.160168:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551938176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.160216:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551938176:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.160222:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789479992.160308:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd785880 x1876405551938176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.160320:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551938176:0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.164127:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938048 00000100:00100000:0.0:1789479992.164149:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938048 00000100:00100000:0.0:1789479992.164267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789479992.164315:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551938048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.164609:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551938048:12345-0@lo:400:kworker.0 Request processed in 331us (4708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479992.164618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789479992.164757:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551938048:0@lo:400:kworker.0 00000100:00080000:3.0:1789479992.164861:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479992.164868:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789479992.346689:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479992.667473:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479992.667514:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551938560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479992.667617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479992.667799:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938560 00000100:00100000:1.0:1789479992.667810:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938560 00000100:00100000:1.0:1789479992.667881:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789479992.667894:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551938560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479992.667947:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789479992.668021:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551938560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479992.668028:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789479992.668307:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e1880 x1876405551938560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479992.668330:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551938560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479993.180329:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551938688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479993.180434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479993.180563:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938688 00000100:00100000:3.0:1789479993.180574:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938688 00000100:00100000:3.0:1789479993.180740:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789479993.180751:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551938688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479993.180801:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789479993.182551:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551938688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1790us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479993.182567:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789479993.184316:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a485f100 x1876405551938688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479993.184352:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551938688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789479993.373469:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479994.396474:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479995.419023:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479996.279766:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479996.279812:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479996.279845:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479996.279866:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479996.279888:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789479996.279917:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738176 00000100:00100000:0.0:1789479996.279939:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738176 00000100:00100000:0.0:1789479996.279994:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738304 00000100:00100000:0.0:1789479996.279998:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738304 00000100:00100000:0.0:1789479996.280034:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789479996.280044:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738176:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479996.280121:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738176:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479996.280129:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789479996.280146:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789479996.280154:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738304:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479996.280179:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738304:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479996.280186:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789479996.280207:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737792 00000100:00100000:0.0:1789479996.280210:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737792 00000100:00100000:0.0:1789479996.280238:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:0.0:1789479996.280244:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526737792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479996.280267:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526737792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479996.280274:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:0.0:1789479996.280338:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526737920 00000100:00100000:0.0:1789479996.280352:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526737920 00000100:00100000:0.0:1789479996.280380:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738048 00000100:00100000:0.0:1789479996.280383:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738048 00000100:00100000:0.0:1789479996.280418:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1789479996.280425:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526737920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479996.280452:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526737920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479996.280468:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1789479996.280482:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1789479996.280488:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789479996.280513:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479996.280519:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00080000:3.0:1789479996.282654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479996.282665:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479996.282669:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789479996.444123:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479997.281751:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551938816:0@lo:400:kworker.0 00000100:00100000:1.0:1789479997.281840:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479997.282024:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938816 00000100:00100000:0.0:1789479997.282033:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938816 00000100:00100000:0.0:1789479997.282082:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789479997.282091:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551938816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.284730:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551938816:12345-0@lo:400:kworker.0 Request processed in 2633us (2882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.284744:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789479997.284836:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551938944:0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.284893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479997.284936:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551939456:0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.284969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479997.285003:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551938816:0@lo:400:kworker.0 00000100:00100000:1.0:1789479997.285030:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551939328:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.285687:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551939072:0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.287319:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551938944 00000100:00100000:0.0:1789479997.287340:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551938944 00000100:00100000:0.0:1789479997.287400:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789479997.287411:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551938944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.287507:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551938944:12345-0@lo:400:kworker.0 Request processed in 97us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.287514:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789479997.287557:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939456 00000100:00100000:0.0:1789479997.287562:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939456 00000100:00100000:0.0:1789479997.287609:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479997.287616:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551939456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.287653:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551939456:12345-0@lo:400:kworker.0 Request processed in 37us (2683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.287659:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479997.287699:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551938944:0@lo:400:kworker.0 00010000:00080000:0.0:1789479997.287713:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec1f80 x1876405551939456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479997.287723:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551939456:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.287962:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551939200:0@lo:400:kworker.0 00000100:00080000:3.0:1789479997.287977:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789479997.288019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479997.288663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.288815:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939328 00000100:00100000:3.0:1789479997.288821:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939328 00000100:00100000:3.0:1789479997.288875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789479997.288884:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551939328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.288938:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551939328:12345-0@lo:400:kworker.0 Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.288944:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789479997.289068:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479997.289095:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551939328:0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.289384:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939200 00000100:00100000:0.0:1789479997.289389:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939200 00000100:00100000:0.0:1789479997.289442:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789479997.289450:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551939200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.289492:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551939200:12345-0@lo:400:kworker.0 Request processed in 44us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.289499:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789479997.289553:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789479997.289686:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec0a80 x1876405551939200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.289699:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551939200:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.289843:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479997.290002:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939072 00000100:00100000:0.0:1789479997.290007:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939072 00000100:00100000:0.0:1789479997.290098:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789479997.290106:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551939072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.290208:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551939072:12345-0@lo:400:kworker.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.290214:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789479997.290440:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479997.290495:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551939072:0@lo:400:kworker.0 00010000:00010000:1.0:1789479997.475485:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479997.792016:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479997.800886:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551939584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479997.800982:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479997.801056:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939584 00000100:00100000:0.0:1789479997.801063:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939584 00000100:00100000:0.0:1789479997.801112:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789479997.801121:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551939584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789479997.801159:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479997.801205:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551939584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479997.801214:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789479997.801256:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e1c00 x1876405551939584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479997.801276:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551939584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479998.299623:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479998.299661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551939712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479998.299737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479998.301218:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939712 00000100:00100000:0.0:1789479998.301228:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939712 00000100:00100000:0.0:1789479998.301338:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789479998.301349:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551939712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479998.301402:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789479998.301505:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551939712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479998.301513:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789479998.302526:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ddf80 x1876405551939712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479998.302576:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551939712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789479998.492521:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479999.517634:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480000.540119:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480001.398055:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480001.398099:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480001.398144:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480001.398169:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738816 00000100:00100000:2.0:1789480001.398171:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480001.398180:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738816 00000100:00100000:2.0:1789480001.398230:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480001.398323:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738944 00000100:00100000:1.0:1789480001.398327:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738944 00000100:00100000:1.0:1789480001.398361:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789480001.398373:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2344:x1876405526738816:12345-192.168.204.54@tcp:9:kworker.0 00000100:00100000:0.0:1789480001.398394:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480001.398408:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2344:x1876405526738944:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1789480001.398411:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd533 00000100:00080000:1.0:1789480001.398427:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d229c50a000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789480001.398436:0:8279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd53a 00000100:00080000:0.0:1789480001.398448:0:8279:0:(import.c:65:import_set_state_nolock()) ffff8d22bb591000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480001.398493:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:0.0:1789480001.398498:0:8279:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789480001.399274:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+2:2344:x1876405526738816:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 899us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480001.399306:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:1.0:1789480001.399328:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480001.399332:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480001.399345:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480001.399888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738688 00000100:00100000:3.0:1789480001.399895:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738688 00000100:00100000:3.0:1789480001.400020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738560 00000100:00100000:3.0:1789480001.400024:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738560 00000100:00100000:3.0:1789480001.401415:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1789480001.401429:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738688:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480001.401578:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+2:2344:x1876405526738944:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 3173us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480001.401588:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480001.401625:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526738432 00000100:00100000:0.0:1789480001.401632:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526738432 00000100:00080000:1.0:1789480001.402761:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480001.406797:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480001.406799:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:0.0:1789480001.406842:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526738432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480001.406932:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526738432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (8787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480001.406939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:0.0:1789480001.406995:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1789480001.407006:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526738560:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480001.407054:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526738560:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 50us (8823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480001.407062:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:3.0:1789480001.410351:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526738688:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 8914us (12167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480001.410368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00010000:00010000:3.0:1789480001.565562:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789480001.929857:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000020:00000080:0.0:1789480001.929868:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d22bb592800/4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000020:00000080:3.0:1789480001.929955:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb592800/4b6ec658-f7f1-408f-9531-0dbaf67922ea for lustre-OST0001 00000020:00000080:3.0:1789480001.930021:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22bb591000 for lustre-OST0001 00000100:00100000:1.0:1789480002.397949:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551940096:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.398255:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551939840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.402613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.402698:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551940352:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.402750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.402791:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789480002.402799:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551939968:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.402821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.402839:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551940480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.402888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.402949:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939840 00000100:00100000:0.0:1789480002.402959:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939840 00000100:00100000:0.0:1789480002.403271:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789480002.403323:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551939840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.403974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480002.404124:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480002.404135:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551940224:0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.404174:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480002.404214:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940480 00000100:00100000:1.0:1789480002.404219:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940480 00000100:00100000:1.0:1789480002.404496:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940224 00000100:00100000:1.0:1789480002.404501:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940224 00000100:00100000:3.0:1789480002.404504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940352 00000100:00100000:3.0:1789480002.404508:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940352 00000100:00100000:3.0:1789480002.404537:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551939968 00000100:00100000:3.0:1789480002.404540:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551939968 00000100:00100000:1.0:1789480002.404541:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789480002.404551:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551940480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.404558:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940096 00000100:00100000:3.0:1789480002.404562:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940096 00000100:00100000:0.0:1789480002.404567:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551939840:12345-0@lo:400:kworker.0 Request processed in 1272us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.404578:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789480002.404586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789480002.404589:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.404616:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551940480:12345-0@lo:400:kworker.0 Request processed in 65us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480002.404624:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789480002.404636:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551940352:12345-0@lo:400:kworker.0 Request processed in 50us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.404643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789480002.404649:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789480002.404656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789480002.404656:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551940224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.404669:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551939968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.404691:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551940224:12345-0@lo:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.404694:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551939968:12345-0@lo:400:kworker.0 Request processed in 26us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480002.404697:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789480002.404699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789480002.404709:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789480002.404714:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551940096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789480002.404714:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480002.404719:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480002.404722:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480002.404743:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551940096:12345-0@lo:400:kworker.0 Request processed in 29us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.404750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1789480002.404771:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e1500 x1876405551940224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.404820:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551939968:0@lo:400:kworker.0 00010000:00080000:0.0:1789480002.404838:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd7e3480 x1876405551940480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.404851:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551940480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.404861:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551939840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.404873:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551940352:0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.405396:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551940224:0@lo:400:kworker.0 00000100:00100000:1.0:1789480002.405419:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551940096:0@lo:400:kworker.0 00010000:00010000:3.0:1789480002.601380:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480002.915783:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480002.915813:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551940608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480002.915901:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480002.916409:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940608 00000100:00100000:2.0:1789480002.916420:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940608 00000100:00100000:2.0:1789480002.916487:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789480002.916498:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551940608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480002.916543:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480002.916605:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551940608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480002.916613:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789480002.916691:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd785c00 x1876405551940608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480002.916715:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551940608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480003.419426:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480003.419557:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551940736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480003.419648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480003.420997:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940736 00000100:00100000:0.0:1789480003.421012:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940736 00000100:00100000:2.0:1789480003.421453:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789480003.421468:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551940736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480003.421519:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480003.421617:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551940736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480003.421625:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789480003.421730:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba94aa00 x1876405551940736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480003.421755:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551940736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480003.611503:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480004.636682:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480005.665136:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789480006.058546:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000020:00000080:0.0:1789480006.058558:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d229c50d800/4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000020:00000080:3.0:1789480006.059397:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50d800/4b6ec658-f7f1-408f-9531-0dbaf67922ea for lustre-OST0000 00000020:00000080:3.0:1789480006.059477:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d229c50a000 for lustre-OST0000 00000100:00100000:3.0:1789480006.511130:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480006.511203:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480006.511249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480006.511365:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739328 00000100:00100000:2.0:1789480006.511378:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739328 00000100:00100000:2.0:1789480006.511463:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739200 00000100:00100000:2.0:1789480006.511466:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739200 00000100:00100000:2.0:1789480006.511495:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789480006.511508:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526739328:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480006.511644:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526739328:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 138us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480006.511653:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789480006.511681:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1789480006.511688:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526739200:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480006.511714:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526739200:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480006.511720:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789480006.512122:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739072 00000100:00100000:0.0:1789480006.512127:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739072 00000100:00100000:0.0:1789480006.512179:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:0.0:1789480006.512188:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526739072:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480006.512229:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526739072:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 42us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480006.512250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00080000:3.0:1789480006.513090:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480006.682887:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480007.522346:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551940992:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.522524:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551941504:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.522588:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789480007.522595:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551940864:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.522649:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551941376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522671:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.522703:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940992 00000100:00100000:2.0:1789480007.522713:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940992 00000100:00100000:2.0:1789480007.522768:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941376 00000100:00100000:2.0:1789480007.522772:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941376 00000100:00100000:2.0:1789480007.522810:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789480007.522820:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551940992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522883:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551940992:12345-0@lo:400:kworker.0 Request processed in 64us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480007.522902:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789480007.522922:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789480007.522928:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551941376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.522956:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551941376:12345-0@lo:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480007.522961:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789480007.523015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551941376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.523028:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551940992:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527035:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551941120:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527149:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.527217:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480007.527226:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551941248:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.527324:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941504 00000100:00100000:1.0:1789480007.527334:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941504 00000100:00100000:1.0:1789480007.527396:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941248 00000100:00100000:1.0:1789480007.527399:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941248 00000100:00100000:1.0:1789480007.527450:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480007.527460:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551941504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527534:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551941504:12345-0@lo:400:kworker.0 Request processed in 75us (4979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.527543:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480007.527580:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789480007.527586:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551941248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527620:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551941248:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.527627:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789480007.527649:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941120 00000100:00100000:1.0:1789480007.527653:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941120 00000100:00100000:1.0:1789480007.527683:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789480007.527689:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551941120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527717:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551941120:12345-0@lo:400:kworker.0 Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.527722:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789480007.527798:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7ce00 x1876405551941504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.527816:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551941504:0@lo:400:kworker.0 00010000:00080000:1.0:1789480007.527849:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7e680 x1876405551941248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.527859:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551941248:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.527868:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551941120:0@lo:400:kworker.0 00000100:00080000:1.0:1789480007.527910:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480007.527915:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480007.527918:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480007.532169:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551940864 00000100:00100000:0.0:1789480007.532187:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551940864 00000100:00100000:0.0:1789480007.532276:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789480007.532312:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551940864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.534577:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551940864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480007.535130:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551940864:12345-0@lo:400:kworker.0 Request processed in 2809us (12486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480007.535144:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00010000:1.0:1789480007.706953:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480008.040663:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480008.040693:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551941632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480008.040782:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480008.041007:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941632 00000100:00100000:2.0:1789480008.041018:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941632 00000100:00100000:2.0:1789480008.041143:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789480008.041155:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551941632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480008.041202:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480008.041269:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551941632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480008.041276:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789480008.041408:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7c700 x1876405551941632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480008.041429:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551941632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480008.539440:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480008.539475:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551941760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480008.539570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480008.539656:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941760 00000100:00100000:2.0:1789480008.539667:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941760 00000100:00100000:2.0:1789480008.539729:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789480008.539741:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551941760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480008.539792:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480008.539844:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551941760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480008.539868:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789480008.539924:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7fb80 x1876405551941760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480008.539948:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551941760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789480008.730914:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789480009.416436:0:11024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789480009.757599:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480010.788716:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480011.636274:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480011.636439:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480011.636513:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480011.639744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739712 00000100:00100000:0.0:1789480011.639759:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739712 00000100:00100000:0.0:1789480011.639848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739584 00000100:00100000:0.0:1789480011.639851:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739584 00000100:00100000:0.0:1789480011.639882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789480011.639892:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526739712:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480011.639985:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526739712:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 94us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480011.639992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789480011.640009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1789480011.640016:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526739584:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480011.640038:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526739584:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (3525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480011.640059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00080000:3.0:1789480011.642505:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480011.644239:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739456 00000100:00100000:2.0:1789480011.644253:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739456 00000100:00100000:2.0:1789480011.647356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1789480011.647384:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526739456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480011.647522:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526739456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 150us (11260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480011.647530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00010000:00010000:3.0:1789480011.804029:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480012.634577:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551942144:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.634664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.634725:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480012.634732:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551942272:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.634758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.634797:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942144 00000100:00100000:3.0:1789480012.634804:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942144 00000100:00100000:3.0:1789480012.634862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789480012.634872:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551942144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.634925:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551942144:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.634932:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789480012.634960:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942272 00000100:00100000:3.0:1789480012.634963:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942272 00000100:00100000:3.0:1789480012.634991:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789480012.634997:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551942272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.635044:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551942272:12345-0@lo:400:kworker.0 Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.635051:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789480012.635069:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480012.635074:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789480012.635107:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec2d80 x1876405551942272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480012.635121:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551942272:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.635148:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551942144:0@lo:400:kworker.0 00000100:00100000:2.0:1789480012.635228:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551941888:0@lo:400:kworker.0 00000100:00100000:2.0:1789480012.635271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480012.635330:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551942400:0@lo:400:kworker.0 00000100:00100000:2.0:1789480012.635358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480012.635375:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480012.635381:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551942016:0@lo:400:kworker.0 00000100:00100000:2.0:1789480012.635402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480012.635418:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551942528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480012.635438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480012.635530:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942400 00000100:00100000:1.0:1789480012.635535:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942400 00000100:00100000:1.0:1789480012.635575:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942016 00000100:00100000:1.0:1789480012.635578:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942016 00000100:00100000:1.0:1789480012.635596:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789480012.635603:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551942400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480012.635648:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551942400:12345-0@lo:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480012.635653:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789480012.635675:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789480012.635682:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551942016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480012.635713:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551942016:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480012.635718:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789480012.635744:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942528 00000100:00100000:1.0:1789480012.635748:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942528 00000100:00100000:1.0:1789480012.635774:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789480012.635779:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551942528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480012.635806:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551942528:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480012.635812:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789480012.635841:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551942016:0@lo:400:kworker.0 00010000:00080000:1.0:1789480012.635853:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452d180 x1876405551942528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480012.635862:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551942528:0@lo:400:kworker.0 00000100:00100000:1.0:1789480012.635870:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551942400:0@lo:400:kworker.0 00000100:00080000:2.0:1789480012.635949:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480012.635953:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480012.636081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551941888 00000100:00100000:3.0:1789480012.636086:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551941888 00000100:00100000:3.0:1789480012.636210:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789480012.636218:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.636272:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551941888:12345-0@lo:400:kworker.0 Request processed in 55us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.636278:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789480012.636480:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551941888:0@lo:400:kworker.0 00010000:00010000:3.0:1789480012.831714:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480013.150723:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480013.150747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551942656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480013.150835:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480013.150908:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942656 00000100:00100000:2.0:1789480013.150916:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942656 00000100:00100000:2.0:1789480013.150964:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789480013.150973:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551942656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480013.151028:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480013.151075:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551942656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480013.151082:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789480013.154699:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22c1e7ce00 x1876405551942656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480013.154734:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551942656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480013.658518:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551942784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480013.658614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480013.658691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551942784 00000100:00100000:0.0:1789480013.658707:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551942784 00000100:00100000:0.0:1789480013.659067:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789480013.659088:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551942784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480013.659141:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480013.659253:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551942784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480013.659261:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789480013.659398:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea98e00 x1876405551942784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480013.659420:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551942784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480013.852542:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789480014.247498:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff52d40960 20000000:00000080:2.0:1789480014.247519:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22bad6e800 uarg=0000000000000000 20000000:01000000:2.0:1789480014.247562:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789480014.247568:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789480014.247574:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789480014.248559:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789480014.248730:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789480014.259227:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789480014.259599:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259624:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259637:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259646:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259653:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd509 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259660:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259668:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259729:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259746:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 12 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.259765:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551942912:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480014.259908:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.259916:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.259924:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943040:0@lo:104: 00000100:00100000:3.0:1789480014.259965:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480014.260645:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.260654:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.260662:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943168:0@lo:104: 00000100:00100000:3.0:1789480014.260688:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480014.261779:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.261948:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.261974:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943296:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480014.262085:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.262093:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 18 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.262102:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943424:0@lo:104: 00000100:00100000:3.0:1789480014.262132:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480014.262790:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943040 00000100:00100000:2.0:1789480014.262868:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943040 00000100:00100000:2.0:1789480014.262915:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943168 00000100:00100000:2.0:1789480014.262918:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943168 00000100:00100000:2.0:1789480014.262933:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480014.262951:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+4:11173:x1876405551943040:12345-0@lo:104: 00010000:00010000:2.0:1789480014.262965:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.263279:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789480014.263305:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+4:11173:x1876405551943040:12345-0@lo:104: Request processed in 357us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480014.263313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480014.263334:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480014.263340:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:11173:x1876405551943168:12345-0@lo:104: 00010000:00010000:2.0:1789480014.263351:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480014.263565:0:11173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0297f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480014.263595:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943040:0@lo:104: 00000100:00100000:3.0:1789480014.263603:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943168:0@lo:104: 00000100:00100000:0.0:1789480014.263768:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789480014.263777:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789480014.264367:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480014.264376:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264400:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480014.264404:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264413:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480014.264420:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480014.264427:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480014.264501:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264508:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480014.264529:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264536:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fd509 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd510 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264548:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480014.264551:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264556:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480014.264559:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.264589:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480014.264595:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480014.264600:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789480014.264658:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551942912:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480014.264784:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789480014.264800:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:11173:x1876405551943168:12345-0@lo:104: Request processed in 1451us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480014.264809:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480014.264832:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943424 00000100:00100000:2.0:1789480014.264837:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943424 00000100:00100000:2.0:1789480014.264865:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789480014.264872:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:11173:x1876405551943424:12345-0@lo:104: 00010000:00010000:2.0:1789480014.264880:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.264932:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789480014.264937:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e677fecc-98d9-457e-99be-c06439303d19+3:11173:x1876405551943424:12345-0@lo:104: Request processed in 66us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480014.264942:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789480014.265198:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789480014.265234:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943424:0@lo:104: 00010000:00010000:1.0:1789480014.265734:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.265741:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480014.265751:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.265757:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fd4fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd502 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.265766:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480014.265768:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480014.265769:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480014.265785:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551943552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480014.265843:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480014.265892:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480014.265898:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551943680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480014.265924:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480014.265954:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943552 00000100:00100000:1.0:1789480014.265959:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943552 00010000:00010000:1.0:1789480014.266189:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 19 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480014.266231:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943680 00000100:00100000:1.0:1789480014.266235:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943680 00010000:00010000:1.0:1789480014.266250:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 20 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480014.266270:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480014.266276:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+20:3298:x1876405551943552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480014.266309:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480014.266315:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 20 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266325:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 20 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266341:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4e00/0xbb972366037fd510 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd509 expref: 20 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266354:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480014.266387:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551943552:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480014.266394:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480014.266438:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480014.266445:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+18:3298:x1876405551943680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480014.266452:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480014.266457:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266465:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266482:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5e00/0xbb972366037fd502 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd4fb expref: 18 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.266491:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480014.266514:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551943680:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480014.266520:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480014.266556:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551943680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480014.266565:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551943552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480014.267315:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480014.267318:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480014.267319:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480014.267557:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.267567:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480014.267647:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.267659:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480014.267666:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480014.267680:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480014.267756:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.267763:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789480014.267881:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789480014.267900:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.267907:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280030a00/0xbb972366037fd4e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd4ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.267921:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480014.267923:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480014.267925:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480014.268134:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551943808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480014.268196:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480014.268909:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943808 00000100:00100000:1.0:1789480014.268919:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943808 00010000:00010000:1.0:1789480014.268953:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480014.269167:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789480014.269178:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+17:3301:x1876405551943808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480014.269192:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480014.269198:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.269209:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.269226:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22baffee00/0xbb972366037fd4ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd4e6 expref: 17 pid: 5823 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480014.269253:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480014.269495:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+16:3301:x1876405551943808:12345-0@lo:103:ldlm_bl.0 Request processed in 318us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480014.269504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480014.269649:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551943808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480014.274668:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876405551943296:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480014.274711:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480014.278157:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480014.278215:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480014.278346:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739840 00000100:00100000:2.0:1789480014.278359:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739840 00010000:00010000:2.0:1789480014.278404:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 13 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480014.278448:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526739968 00000100:00100000:2.0:1789480014.278451:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526739968 00010000:00010000:2.0:1789480014.278465:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 14 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480014.278487:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1789480014.278497:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+14:2347:x1876405526739840:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480014.278517:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480014.278523:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 14 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278538:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 14 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278557:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fd525 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f310e expref: 14 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278770:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480014.278829:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526739840:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 333us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480014.278851:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1789480014.278868:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1789480014.278873:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:2347:x1876405526739968:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480014.278881:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480014.278886:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278896:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278906:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4800/0xbb972366037fd4f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30d6 expref: 12 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278919:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278927:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278942:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278949:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278955:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278962:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278973:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480014.278978:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.278986:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.279008:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.279186:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.279194:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480014.279201:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd541 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480014.283515:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480014.283903:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:2347:x1876405526739968:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5019us (5677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480014.283918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00010000:00010000:1.0:1789480014.874805:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480015.899914:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480015.983176:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480015.983346:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740096 00000100:00100000:2.0:1789480015.983356:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740096 00000100:00100000:2.0:1789480015.983415:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:2.0:1789480015.983426:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:5592:x1876405526740096:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480015.983443:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480015.983465:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3138 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480015.983495:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480015.983507:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480015.983535:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffa00, rc 0) 00000100:00100000:2.0:1789480015.983626:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740096:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 202us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480015.983634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:3.0:1789480015.993710:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480015.993981:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740224 00000100:00100000:0.0:1789480015.993992:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740224 00000100:00100000:0.0:1789480015.994068:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1789480015.994079:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740224:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480015.994609:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740224:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 529us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480015.997702:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1789480016.007950:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480016.008954:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740352 00000100:00100000:3.0:1789480016.008994:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740352 00000100:00100000:3.0:1789480016.009074:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:3.0:1789480016.009084:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740352:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.009386:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740352:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 302us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.009395:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:3.0:1789480016.016119:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480016.017356:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740480 00000100:00100000:0.0:1789480016.017374:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740480 00000100:00100000:0.0:1789480016.017456:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:0.0:1789480016.017468:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526740480:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480016.017495:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480016.017522:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f313f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.017573:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.017602:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.017614:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280031c00, rc 0) 00000100:00100000:0.0:1789480016.017722:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526740480:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 255us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480016.017729:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:0.0:1789480016.026971:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480016.027140:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740608 00000100:00100000:3.0:1789480016.027151:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740608 00000100:00100000:3.0:1789480016.027223:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:3.0:1789480016.027234:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526740608:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.027837:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526740608:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 601us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.027846:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1789480016.039047:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480016.039840:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740736 00000100:00100000:3.0:1789480016.039854:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740736 00000100:00100000:3.0:1789480016.039923:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:3.0:1789480016.039934:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526740736:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.041113:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526740736:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 1174us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.041129:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 10000000:01000000:2.0:1789480016.154451:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789480016.154461:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22b9aa2800 from 7 10000000:01000000:2.0:1789480016.154466:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480016.154511:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.154524:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.154547:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480016.154572:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551943936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480016.154657:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480016.154912:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480016.156585:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551943936 00000100:00100000:0.0:1789480016.156597:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551943936 00000100:00100000:0.0:1789480016.156654:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789480016.156663:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551943936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480016.156690:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480016.156710:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd556 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.156738:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd556 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.156748:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd556 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480016.156757:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2280030400, rc 0) 00000100:00100000:0.0:1789480016.156982:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551943936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480016.156989:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789480016.157182:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551943936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480016.157202:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.157213:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480016.157316:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480016.157360:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480016.157388:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.157458:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944064 00000100:00100000:3.0:1789480016.157464:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944064 00000100:00100000:3.0:1789480016.157502:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789480016.157510:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551944064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.157910:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551944064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.157918:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789480016.157968:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.157997:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.158862:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480016.158886:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.158905:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944192 00000100:00100000:3.0:1789480016.158909:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944192 00000100:00100000:3.0:1789480016.158934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789480016.158941:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551944192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.159424:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551944192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 482us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.159432:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789480016.159482:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480016.164215:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789480016.169037:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789480016.169079:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480016.169092:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.169106:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480016.169117:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789480016.169119:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22a4535800 from 7 10000000:01000000:2.0:1789480016.169122:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480016.169161:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.169170:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.169183:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480016.169211:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480016.169316:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480016.169372:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22b23dfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.169496:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944320 00000100:00100000:3.0:1789480016.169504:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944320 00000100:00100000:3.0:1789480016.169566:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789480016.169575:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551944320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480016.169587:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480016.169601:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd564 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.169626:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd564 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.169658:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd564 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.169667:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4000, rc 0) 00000100:00100000:3.0:1789480016.169724:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.169730:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789480016.170023:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480016.170038:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480016.170047:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480016.170104:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480016.170132:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480016.170165:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480016.170219:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944448 00000100:00100000:2.0:1789480016.170223:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944448 00000100:00100000:2.0:1789480016.170257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789480016.170265:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480016.170563:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480016.170575:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789480016.170969:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480016.171006:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480016.171046:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480016.171065:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.171137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944576 00000100:00100000:3.0:1789480016.171142:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944576 00000100:00100000:3.0:1789480016.171175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789480016.171182:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.171349:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.171355:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789480016.171442:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480016.183186:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789480016.183563:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789480016.183602:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480016.183614:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480016.183626:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480016.183648:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480016.183650:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22aea50800 from 7 10000000:01000000:1.0:1789480016.183653:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480016.183700:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480016.183709:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480016.183720:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480016.183745:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480016.183819:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480016.183859:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb0f2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.189278:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944704 00000100:00100000:3.0:1789480016.189321:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944704 00000100:00100000:3.0:1789480016.189401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789480016.189412:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551944704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480016.189429:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480016.189449:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd572 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.189480:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd572 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.189490:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd572 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.189516:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5200, rc 0) 00000100:00100000:3.0:1789480016.189626:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551944704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.189638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789480016.189871:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480016.189892:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480016.189902:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480016.189980:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.190014:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480016.190043:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.190058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944832 00000100:00100000:3.0:1789480016.190061:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944832 00000100:00100000:3.0:1789480016.190082:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789480016.190088:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551944832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.190346:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551944832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.190352:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789480016.190397:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.190423:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.190458:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480016.190476:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480016.190487:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551944960 00000100:00100000:3.0:1789480016.190490:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551944960 00000100:00100000:3.0:1789480016.190504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789480016.190509:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551944960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480016.192797:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551944960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480016.192818:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789480016.192921:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551944960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480016.195478:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789480016.204799:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789480016.204839:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480016.204851:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480016.204864:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480016.772034:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480016.772258:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480016.772310:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480016.772359:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740992 00000100:00100000:3.0:1789480016.772369:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741120 00000100:00100000:2.0:1789480016.772369:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740992 00000100:00100000:3.0:1789480016.772376:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741120 00000100:00100000:3.0:1789480016.772438:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:3.0:1789480016.772448:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526741120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480016.772532:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526741120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480016.772532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1789480016.772546:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1789480016.772548:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526740992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480016.772581:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526740992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480016.772587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00080000:2.0:1789480016.772610:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480016.772804:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526740864 00000100:00100000:1.0:1789480016.772810:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526740864 00000100:00100000:1.0:1789480016.772850:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:1.0:1789480016.772859:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526740864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480016.772906:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526740864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 48us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480016.772912:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00010000:00010000:3.0:1789480016.925337:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480017.757231:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551945088:0@lo:400:kworker.0 00000100:00100000:3.0:1789480017.757324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.757420:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945088 00000100:00100000:0.0:1789480017.757436:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945088 00000100:00100000:0.0:1789480017.757486:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789480017.757494:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551945088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.761446:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551945088:12345-0@lo:400:kworker.0 Request processed in 3941us (4110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.761463:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789480017.764853:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551945472:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.764946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.765118:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945472 00000100:00100000:1.0:1789480017.765127:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945472 00000100:00100000:1.0:1789480017.765202:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789480017.765211:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551945472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.765650:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480017.765661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551945600:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.766461:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551945472:12345-0@lo:400:kworker.0 Request processed in 1248us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.766471:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789480017.766502:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480017.766724:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551945088:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.767739:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551945344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.767808:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.768067:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789480017.768196:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551945216:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.768223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.768252:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551945728:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.768276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.768498:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945344 00000100:00100000:1.0:1789480017.768592:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945344 00000100:00100000:1.0:1789480017.768722:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945216 00000100:00100000:1.0:1789480017.768726:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945216 00000100:00100000:1.0:1789480017.768751:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480017.768759:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551945344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.768818:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551945344:12345-0@lo:400:kworker.0 Request processed in 60us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.768825:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480017.769067:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789480017.769236:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480017.769273:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551945216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.769342:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551945216:12345-0@lo:400:kworker.0 Request processed in 269us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.769350:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789480017.769377:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945728 00000100:00100000:1.0:1789480017.769381:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945728 00000100:00100000:1.0:1789480017.769412:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789480017.769418:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551945728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.769450:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551945728:12345-0@lo:400:kworker.0 Request processed in 33us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.769467:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789480017.769729:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480017.770212:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789480017.770276:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea9ad80 x1876405551945472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480017.770314:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551945472:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.771420:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551945216:0@lo:400:kworker.0 00010000:00080000:1.0:1789480017.771439:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea98a80 x1876405551945728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480017.771450:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551945728:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.771462:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551945344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.771979:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945600 00000100:00100000:0.0:1789480017.772060:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945600 00000100:00100000:0.0:1789480017.772212:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789480017.772221:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551945600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.772339:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551945600:12345-0@lo:400:kworker.0 Request processed in 118us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.772347:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789480017.772466:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551945600:0@lo:400:kworker.0 00000100:00080000:1.0:1789480017.772624:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480017.985489:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480018.266548:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551945856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480018.266627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480018.266766:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945856 00000100:00100000:2.0:1789480018.266775:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945856 00000100:00100000:2.0:1789480018.266839:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480018.267528:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551945856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480018.267568:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480018.267634:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551945856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480018.267642:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789480018.267748:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea99c00 x1876405551945856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480018.267788:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551945856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480018.783848:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480018.783871:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551945984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480018.783956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480018.784039:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551945984 00000100:00100000:3.0:1789480018.784047:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551945984 00000100:00100000:3.0:1789480018.784097:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789480018.784105:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551945984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480018.784141:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480018.784185:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551945984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480018.784192:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789480018.784231:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec2a00 x1876405551945984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480018.784249:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551945984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480019.045464:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480020.062152:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480020.737003:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789480021.082481:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480021.874187:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480021.874251:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480021.874325:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480021.876692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741248 00000100:00100000:3.0:1789480021.876708:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741248 00000100:00100000:3.0:1789480021.876802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:3.0:1789480021.876815:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526741248:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480021.876917:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526741248:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480021.876937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:0.0:1789480021.884667:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741376 00000100:00100000:0.0:1789480021.884695:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741376 00000100:00100000:3.0:1789480021.884947:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741504 00000100:00100000:3.0:1789480021.884953:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741504 00000100:00100000:3.0:1789480021.885006:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1789480021.885017:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526741376:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480021.885116:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526741376:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 101us (10945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480021.885123:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1789480021.885158:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:3.0:1789480021.885165:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526741504:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480021.885192:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526741504:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (10867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480021.885197:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00080000:2.0:1789480021.885451:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480022.107204:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480022.874639:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551946240:0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.874744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480022.874832:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551946752:0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.874864:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480022.874901:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480022.874908:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551946368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.874933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480022.875012:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551946112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.875054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480022.875080:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551946624:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.875103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480022.875121:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480022.875126:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551946496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.875147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480022.875810:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946240 00000100:00100000:0.0:1789480022.875832:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946240 00000100:00100000:0.0:1789480022.875893:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946368 00000100:00100000:0.0:1789480022.875897:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946368 00000100:00100000:0.0:1789480022.875927:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946624 00000100:00100000:0.0:1789480022.875930:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946624 00000100:00100000:0.0:1789480022.875952:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789480022.875964:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551946240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876042:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551946240:12345-0@lo:400:kworker.0 Request processed in 80us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876051:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789480022.876074:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789480022.876081:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551946368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876112:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551946368:12345-0@lo:400:kworker.0 Request processed in 31us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876118:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789480022.876147:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789480022.876154:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551946624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876185:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551946624:12345-0@lo:400:kworker.0 Request processed in 32us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876191:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789480022.876210:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946752 00000100:00100000:0.0:1789480022.876214:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946752 00000100:00100000:0.0:1789480022.876241:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946496 00000100:00100000:0.0:1789480022.876244:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946496 00000100:00100000:0.0:1789480022.876263:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789480022.876270:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551946752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876322:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551946752:12345-0@lo:400:kworker.0 Request processed in 52us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876328:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789480022.876340:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789480022.876345:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551946496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876374:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551946496:12345-0@lo:400:kworker.0 Request processed in 28us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876380:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789480022.876405:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946112 00000100:00100000:0.0:1789480022.876409:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946112 00000100:00100000:0.0:1789480022.876436:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789480022.876443:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551946112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876476:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551946112:12345-0@lo:400:kworker.0 Request processed in 33us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480022.876483:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789480022.876565:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551946368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480022.876591:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551946240:0@lo:400:kworker.0 00010000:00080000:0.0:1789480022.876606:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd5d5500 x1876405551946752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480022.876617:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551946752:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.876888:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba94aa00 x1876405551946496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.876899:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551946496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.876909:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551946112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.876920:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd5d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551946624:0@lo:400:kworker.0 00000100:00080000:2.0:1789480022.877008:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480022.877014:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480022.877017:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480023.130779:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480023.387873:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551946880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480023.387966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480023.388175:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551946880 00000100:00100000:2.0:1789480023.388187:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551946880 00000100:00100000:2.0:1789480023.388256:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789480023.388268:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551946880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480023.388361:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480023.388457:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551946880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480023.388494:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789480023.389587:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea9aa00 x1876405551946880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480023.389775:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551946880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480023.901574:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551947008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480023.901699:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480023.901949:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947008 00000100:00100000:3.0:1789480023.901971:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947008 00000100:00100000:3.0:1789480023.902052:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789480023.902062:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551947008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480023.902112:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480023.902183:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551947008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480023.902209:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789480023.902832:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22baec1f80 x1876405551947008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480023.902857:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551947008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480024.154773:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480025.181546:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480025.929740:0:11473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:47:03 (1789480023) === 00010000:00010000:3.0:1789480026.207519:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480026.280155:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.280206:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.280244:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741632 00000100:00100000:0.0:1789480026.280256:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741632 00000100:00100000:0.0:1789480026.280374:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480026.280391:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526741632:12345-192.168.204.54@tcp:41:mkdir.0 00000004:00000024:0.0:1789480026.280464:0:8260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789480026.280853:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526741632:12345-192.168.204.54@tcp:41:mkdir.0 Request processed in 467us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480026.280863:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480026.281658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526741760 00000100:00100000:3.0:1789480026.281669:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526741760 00000100:00100000:3.0:1789480026.281746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480026.281767:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9676:x1876405526741760:12345-192.168.204.54@tcp:700:mkdir.0 00000100:00100000:3.0:1789480026.281840:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9676:x1876405526741760:12345-192.168.204.54@tcp:700:mkdir.0 Request processed in 85us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480026.281846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00080000:2.0:1789480026.282357:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480026.284334:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.284847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742016 00000100:00100000:2.0:1789480026.284860:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742016 00000100:00100000:2.0:1789480026.284931:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1789480026.284942:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9676:x1876405526742016:12345-192.168.204.54@tcp:36:mkdir.0 00010000:00010000:2.0:1789480026.285013:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480026.293356:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd461 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c1 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293387:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d200) 00010000:00010000:2.0:1789480026.293417:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480026.293812:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293827:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293838:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293886:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293895:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.293903:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.303374:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480026.303394:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303407:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303415:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303422:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480026.303427:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303436:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303453:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d600) 00010000:00010000:2.0:1789480026.303457:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480026.303462:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.303479:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd580 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480026.303502:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d27314c reply state 000000004fc0d193 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480026.303512:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480026.303635:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9676:x1876405526742016:12345-192.168.204.54@tcp:36:mkdir.0 Request processed in 18690us (19308us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789480026.303645:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1789480026.307170:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307195:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307203:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307211:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.307216:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307226:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307252:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d228804da00) 00010000:00010000:1.0:1789480026.307256:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.307322:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.307330:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd587 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.319174:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.319863:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742144 00000100:00100000:2.0:1789480026.319880:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742144 00000100:00100000:2.0:1789480026.319972:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480026.319983:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9677:x1876405526742144:12345-192.168.204.54@tcp:101:chmod.0 00010000:00010000:2.0:1789480026.320007:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.320031:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd58e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3146 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320109:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320124:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320138:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.320179:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480026.320183:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480026.320262:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320337:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd58e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3146 expref: 8 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320359:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3146 expref: 7 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.320368:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d600) 00010000:00010000:2.0:1789480026.320371:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480026.320374:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff800, rc 0) 00000100:00100000:2.0:1789480026.320451:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9677:x1876405526742144:12345-192.168.204.54@tcp:101:chmod.0 Request processed in 467us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480026.320460:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480026.328169:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.329341:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742400 00000100:00100000:1.0:1789480026.329366:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742400 00000100:00100000:1.0:1789480026.329452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1789480026.329464:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9677:x1876405526742400:12345-192.168.204.54@tcp:36:chmod.0 00010000:00010000:1.0:1789480026.329787:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480026.329835:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3146 expref: 7 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.329861:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d600) 00010000:00010000:1.0:1789480026.329877:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480026.329911:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.329925:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.329937:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480026.333731:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c6aa679 reply state 00000000844e936f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.333790:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789480026.333806:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789480026.333951:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:9677:x1876405526742400:12345-192.168.204.54@tcp:36:chmod.0 Request processed in 4483us (5790us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789480026.333961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:1.0:1789480026.343680:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343705:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343714:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343728:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.343733:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343741:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343772:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22abedf500) 00010000:00010000:1.0:1789480026.343776:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789480026.343782:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.343789:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd59c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480026.390128:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.391337:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742528 00000100:00100000:0.0:1789480026.391601:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742528 00000100:00100000:0.0:1789480026.391710:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789480026.391723:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9678:x1876405526742528:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:0.0:1789480026.391767:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480026.391800:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f314d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.391885:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.391903:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.391917:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480026.391971:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789480026.391975:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480026.392019:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.392050:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f314d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.392098:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f314d expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.392107:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:0.0:1789480026.392111:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480026.392115:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480026.392258:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:9678:x1876405526742528:12345-192.168.204.54@tcp:101:chown.0 Request processed in 538us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480026.392267:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789480026.400101:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.400563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742656 00000100:00100000:2.0:1789480026.400578:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742656 00000100:00100000:2.0:1789480026.400657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789480026.400670:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:9678:x1876405526742656:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:2.0:1789480026.400699:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.400737:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd5b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3154 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400855:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400873:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400910:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400929:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400937:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.400944:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401058:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401067:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401074:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.401113:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480026.401117:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480026.401143:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401158:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401165:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401184:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401190:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480026.401195:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401204:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401219:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:2.0:1789480026.401223:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480026.401228:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401253:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401271:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.401278:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402068:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402075:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480026.402079:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402101:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402114:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d228804d200) 00010000:00010000:2.0:1789480026.402117:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480026.402121:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402127:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd5bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402181:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd5b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3154 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402193:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3154 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.402200:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d228804d700) 00010000:00010000:2.0:1789480026.402202:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480026.402204:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:2.0:1789480026.403017:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:9678:x1876405526742656:12345-192.168.204.54@tcp:101:chown.0 Request processed in 2342us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480026.403029:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789480026.409873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.410396:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526742912 00000100:00100000:0.0:1789480026.410409:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526742912 00000100:00100000:0.0:1789480026.410504:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789480026.410518:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+9:9678:x1876405526742912:12345-192.168.204.54@tcp:36:chown.0 00010000:00010000:0.0:1789480026.410605:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480026.410640:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd5c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3154 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.410664:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d228804d700) 00010000:00010000:0.0:1789480026.410678:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480026.410712:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.410741:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.410765:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480026.501659:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789480026.501867:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d7430df reply state 000000001095bb47 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.501885:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789480026.501904:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789480026.502032:0:8260:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789480026.502061:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9678:x1876405526742912:12345-192.168.204.54@tcp:36:chown.0 Request processed in 91541us (92197us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789480026.502072:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:1.0:1789480026.505041:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505064:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505073:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505081:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.505087:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505096:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505145:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:1.0:1789480026.505149:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789480026.505155:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.505162:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fd5cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480026.533246:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.533497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743040 00000100:00100000:0.0:1789480026.533510:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743040 00000100:00100000:0.0:1789480026.533600:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480026.533613:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9679:x1876405526743040:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:0.0:1789480026.533650:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480026.533676:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd5d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f315b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480026.542404:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8638us 00010000:00010000:0.0:1789480026.587695:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.587719:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.587732:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.587749:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.587780:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.587787:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588122:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588133:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588141:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480026.588164:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789480026.588168:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480026.588207:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588221:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588228:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588236:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588242:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480026.588246:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588260:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588272:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:0.0:1789480026.588276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480026.588309:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588316:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd5db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588327:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588332:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588339:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588344:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480026.588347:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588353:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588360:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2290ce3600) 00010000:00010000:0.0:1789480026.588363:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480026.588367:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588383:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd5e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588424:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd5d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f315b expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588439:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f315b expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480026.588446:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:0.0:1789480026.588449:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789480026.588451:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6200, rc 0) 00000100:00100000:0.0:1789480026.588530:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9679:x1876405526743040:12345-192.168.204.54@tcp:101:touch.500 Request processed in 54920us (55307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480026.588540:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480026.594491:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.594695:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743296 00000100:00100000:2.0:1789480026.594705:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743296 00000100:00100000:2.0:1789480026.594783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480026.594792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9679:x1876405526743296:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1789480026.594811:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.594831:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3162 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.600171:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.600206:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.600223:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.609944:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.609972:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.609986:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480026.618652:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789480026.642121:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642144:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642158:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642200:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642208:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642216:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642222:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.642226:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642247:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642261:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:1.0:1789480026.642264:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.642269:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642274:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd5f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480026.642305:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5bf0f80 reply state 000000008544f5ff transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480026.642315:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789480026.642363:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd5f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3162 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642391:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3162 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.642399:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d22abedf500) 00010000:00010000:1.0:1789480026.642401:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480026.642403:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146600, rc 0) 00000100:00100000:1.0:1789480026.642505:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+10:9679:x1876405526743296:12345-192.168.204.54@tcp:101:touch.500 Request processed in 47712us (48023us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789480026.642514:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:1.0:1789480026.653533:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653580:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653588:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653594:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.653599:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653606:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653624:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8d22b7076200) 00010000:00010000:1.0:1789480026.653627:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.653631:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.653637:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd5fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.654241:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.654818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743552 00000100:00100000:2.0:1789480026.654829:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743552 00000100:00100000:2.0:1789480026.654877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789480026.654886:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:9679:x1876405526743552:12345-192.168.204.54@tcp:36:touch.500 00010000:00010000:2.0:1789480026.654947:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480026.654969:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3162 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.654984:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d22abedf500) 00010000:00010000:2.0:1789480026.655002:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480026.655047:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.655060:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.655069:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480026.655219:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b99698c reply state 00000000681cc9d1 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480026.655244:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480026.655403:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+10:9679:x1876405526743552:12345-192.168.204.54@tcp:36:touch.500 Request processed in 517us (1168us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789480026.655409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:1.0:1789480026.657889:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657907:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657915:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657920:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.657934:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657943:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657958:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d228804d200) 00010000:00010000:1.0:1789480026.657961:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.657966:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.657973:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd613 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.660845:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.660936:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743680 00000100:00100000:2.0:1789480026.660946:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743680 00000100:00100000:2.0:1789480026.661011:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789480026.661022:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+9:9679:x1876405526743680:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1789480026.661053:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.661080:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd61a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3169 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.661152:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd61a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3169 expref: 10 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.661168:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd61a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3169 expref: 10 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.661189:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d228804dc00) 00010000:00010000:2.0:1789480026.661193:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480026.661196:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480026.661277:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+10:9679:x1876405526743680:12345-192.168.204.54@tcp:101:touch.500 Request processed in 243us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480026.661320:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789480026.666738:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.666852:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743808 00000100:00100000:1.0:1789480026.666866:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743808 00000100:00100000:1.0:1789480026.666926:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1789480026.666934:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1876405526743808:12345-192.168.204.54@tcp:8:touch.500 00010000:00080000:1.0:1789480026.666967:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:1.0:1789480026.667013:0:6685:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fd621 00002000:00100000:1.0:1789480026.667026:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f712dbb2-3172-402a-b822-94513dd5b6e3/ffff8d22a4913000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480026.667050:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789480026.667338:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789480026.667371:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d22a4911000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480026.667959:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526743808:12345-192.168.204.54@tcp:8:touch.500 Request processed in 1021us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480026.667968:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480026.678661:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.679826:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526743936 00000100:00100000:0.0:1789480026.679837:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526743936 00000100:00100000:0.0:1789480026.680126:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480026.680138:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:0:x1876405526743936:12345-192.168.204.54@tcp:2:touch.500 00000100:00080000:2.0:1789480026.680186:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789480026.781160:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1789480026.781183:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000100:00100000:1.0:1789480026.782175:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:0:x1876405526743936:12345-192.168.204.54@tcp:2:touch.500 Request processed in 102032us (103517us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789480026.782201:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480026.791649:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.791783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526744192 00000100:00100000:2.0:1789480026.791799:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526744192 00000100:00100000:2.0:1789480026.791860:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1789480026.791870:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+10:9679:x1876405526744192:12345-192.168.204.54@tcp:35:touch.500 00000100:00100000:2.0:1789480026.792261:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+11:9679:x1876405526744192:12345-192.168.204.54@tcp:35:touch.500 Request processed in 390us (625us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789480026.792269:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789480026.835777:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.835889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526744320 00000100:00100000:2.0:1789480026.835901:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526744320 00000100:00100000:2.0:1789480026.835967:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1789480026.835979:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+11:9680:x1876405526744320:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1789480026.836004:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.836027:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3170 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836120:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836135:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836147:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.836186:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480026.836190:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480026.836231:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836260:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3170 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836352:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3170 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.836361:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:2.0:1789480026.836364:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480026.836367:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffee00, rc 0) 00000100:00100000:2.0:1789480026.836442:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+12:9680:x1876405526744320:12345-192.168.204.54@tcp:101:rm.0 Request processed in 465us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480026.836449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1789480026.840093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.840246:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526744576 00000100:00100000:2.0:1789480026.840256:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526744576 00000100:00100000:2.0:1789480026.840790:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789480026.840804:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+12:9680:x1876405526744576:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1789480026.840827:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.840849:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3177 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.840951:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480026.841129:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd636 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3177 expref: 14 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.841143:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:2.0:1789480026.841147:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480026.841152:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3177 expref: 14 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.841178:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:2.0:1789480026.841241:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+13:9680:x1876405526744576:12345-192.168.204.54@tcp:101:rm.0 Request processed in 440us (1157us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789480026.841248:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789480026.881898:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.882237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526744704 00000100:00100000:2.0:1789480026.882248:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526744704 00000100:00100000:2.0:1789480026.882348:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1789480026.882359:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:9680:x1876405526744704:12345-192.168.204.54@tcp:37:rm.0 00000100:00100000:1.0:1789480026.896082:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:9680:x1876405526744704:12345-192.168.204.54@tcp:37:rm.0 Request processed in 13711us (14195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480026.896095:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789480026.918401:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.918783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526744960 00000100:00100000:2.0:1789480026.918794:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526744960 00000100:00100000:2.0:1789480026.918860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1789480026.918871:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:9680:x1876405526744960:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1789480026.919424:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:9680:x1876405526744960:12345-192.168.204.54@tcp:35:rm.0 Request processed in 263us (743us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789480026.919508:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480026.928041:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480026.928332:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526745216 00000100:00100000:2.0:1789480026.928343:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526745216 00000100:00100000:2.0:1789480026.928399:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1789480026.928409:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:9680:x1876405526745216:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1789480026.928628:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480026.928665:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f317e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.928790:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd64b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.928820:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd64b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.928833:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd64b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480026.928846:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480026.930386:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f317e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.930418:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd64b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f317e expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480026.932260:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:2.0:1789480026.932271:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480026.932278:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffec00, rc 0) 00000100:00100000:2.0:1789480026.932415:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745216:12345-192.168.204.54@tcp:101:rm.0 Request processed in 4001us (4379us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789480026.932425:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789480026.947249:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.947429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526745344 00000100:00100000:1.0:1789480026.947440:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526745344 00000100:00100000:1.0:1789480026.947496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:1.0:1789480026.947506:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745344:12345-192.168.204.54@tcp:41:rm.0 00000004:00000024:1.0:1789480026.947567:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789480026.947657:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745344:12345-192.168.204.54@tcp:41:rm.0 Request processed in 140us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480026.947665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789480026.957355:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.957522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526745472 00000100:00100000:1.0:1789480026.957532:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526745472 00000100:00100000:1.0:1789480026.957600:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1789480026.957612:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745472:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1789480026.957634:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480026.957666:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd659 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3185 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957735:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957763:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957776:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957816:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957826:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957834:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957951:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957960:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.957967:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480026.958008:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789480026.958013:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480026.958034:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958046:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958054:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958061:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958079:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958086:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.958090:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958099:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958113:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:1.0:1789480026.958116:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.958121:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958128:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958146:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958153:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958159:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958165:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.958169:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958183:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958191:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8d22abedfc00) 00010000:00010000:1.0:1789480026.958193:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.958197:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958203:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958237:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd659 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3185 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958251:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3185 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.958257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d228804dc00) 00010000:00010000:1.0:1789480026.958260:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480026.958263:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147000, rc 0) 00000100:00100000:1.0:1789480026.958389:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+17:9680:x1876405526745472:12345-192.168.204.54@tcp:101:rm.0 Request processed in 779us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480026.958397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1789480026.962953:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.963158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526745728 00000100:00100000:1.0:1789480026.963169:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526745728 00000100:00100000:1.0:1789480026.963234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1789480026.963244:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+17:9680:x1876405526745728:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1789480026.963347:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789480026.963391:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3185 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963414:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd61a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3169 expref: 16 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963424:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d228804dc00) 00010000:00010000:1.0:1789480026.963442:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3170 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963450:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:1.0:1789480026.963454:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480026.963475:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963490:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963500:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963515:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963522:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963528:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963677:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963691:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.963699:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480026.968491:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789480026.968511:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319965227557ns, next at 320965223770ns, rc = 0 00010000:00010000:1.0:1789480026.968612:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968630:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968645:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968656:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968663:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968668:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968698:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480026.968723:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968728:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968758:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968764:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.968768:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968775:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968787:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d22abedf700) 00010000:00010000:1.0:1789480026.968790:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789480026.968795:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968802:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd683 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968822:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968827:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968832:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968837:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.968839:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968853:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968860:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:1.0:1789480026.968862:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.968865:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.968871:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd675 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969262:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480026.969270:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969276:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480026.969279:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969310:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969320:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d22abedf700) 00010000:00010000:3.0:1789480026.969323:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480026.969326:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969332:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd68a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480026.969349:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480026.969351:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480026.969353:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789480026.972187:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dcb2243 reply state 00000000a9e93b3b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480026.972207:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480026.972351:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745728:12345-192.168.204.54@tcp:36:rm.0 Request processed in 9102us (9404us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789480026.972361:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00010000:00010000:1.0:1789480026.975083:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975101:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975109:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975115:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480026.975120:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975148:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975166:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8d22abedfc00) 00010000:00010000:1.0:1789480026.975169:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480026.975175:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480026.975182:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd67c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480026.977439:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.977617:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526745984 00000100:00100000:1.0:1789480026.977629:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526745984 00000100:00100000:1.0:1789480026.977683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789480026.977693:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+15:9680:x1876405526745984:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:1.0:1789480026.978006:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526745984:12345-192.168.204.54@tcp:35:rm.0 Request processed in 313us (587us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789480026.978014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789480026.999156:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480026.999209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480026.999327:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746240 00000100:00100000:1.0:1789480026.999338:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746240 00000100:00100000:1.0:1789480026.999404:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1789480026.999415:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526746240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480026.999506:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526746240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480026.999514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00080000:0.0:1789480026.999917:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480027.000317:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746112 00000100:00100000:2.0:1789480027.000324:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746112 00000100:00100000:2.0:1789480027.000373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 251 00000100:00100000:2.0:1789480027.000382:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526746112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480027.000436:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526746112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 56us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480027.000443:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 251 00000100:00100000:0.0:1789480027.003385:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480027.004506:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746496 00000100:00100000:2.0:1789480027.004536:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746496 00000100:00100000:2.0:1789480027.004606:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1789480027.004617:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+16:9680:x1876405526746496:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1789480027.004878:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789480027.004915:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd64b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f317e expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.004940:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd5e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f315b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.004953:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3d00) 00010000:00010000:2.0:1789480027.004969:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fd5aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f314d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.004977:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:2.0:1789480027.004983:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480027.005010:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.005023:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.005034:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.005046:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.005053:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480027.005070:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.006621:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.006653:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.006666:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480027.007436:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789480027.007458:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007467:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007474:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007480:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480027.007485:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007501:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007515:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2290ce3600) 00010000:00010000:0.0:1789480027.007518:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789480027.007523:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007529:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd69f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007553:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007559:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007565:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007569:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480027.007572:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007578:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007585:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d600) 00010000:00010000:0.0:1789480027.007587:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480027.007590:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480027.007605:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fd691 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480027.007621:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a144dc9e reply state 00000000ce970ca9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480027.007630:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480027.007762:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+15:9680:x1876405526746496:12345-192.168.204.54@tcp:36:rm.0 Request processed in 3127us (4368us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789480027.007770:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00010000:00010000:1.0:1789480027.014203:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014241:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014249:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014255:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480027.014261:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014270:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014317:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d228804da00) 00010000:00010000:1.0:1789480027.014321:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480027.014336:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480027.014343:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd698 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480027.227152:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480027.994876:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551947136:0@lo:400:kworker.0 00000100:00100000:0.0:1789480027.994983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480027.995122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947136 00000100:00100000:3.0:1789480027.995134:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947136 00000100:00100000:3.0:1789480027.995207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789480027.995241:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551947136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996347:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551947520:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996412:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.996486:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947520 00000100:00100000:1.0:1789480027.996494:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947520 00000100:00100000:1.0:1789480027.996551:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480027.996559:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551947520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996608:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551947520:12345-0@lo:400:kworker.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480027.996633:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789480027.996663:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480027.996696:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea9b800 x1876405551947520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480027.996711:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551947520:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996785:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551947264:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996829:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.996851:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480027.996856:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551947392:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.996879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.996909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947264 00000100:00100000:1.0:1789480027.996913:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947264 00000100:00100000:1.0:1789480027.996956:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947392 00000100:00100000:1.0:1789480027.996959:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947392 00000100:00100000:1.0:1789480027.996986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789480027.996992:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551947264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.997253:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551947264:12345-0@lo:400:kworker.0 Request processed in 260us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480027.997260:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789480027.997276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789480027.997322:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551947392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.997354:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551947392:12345-0@lo:400:kworker.0 Request processed in 72us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480027.997361:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1789480027.997386:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480027.997417:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551947392:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.997428:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551947264:0@lo:400:kworker.0 00000100:00100000:3.0:1789480028.006963:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551947136:12345-0@lo:400:kworker.0 Request processed in 11713us (11967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480028.006979:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789480028.008819:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480028.008851:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551947648:0@lo:400:kworker.0 00000100:00100000:3.0:1789480028.008948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480028.009011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947648 00000100:00100000:3.0:1789480028.009021:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947648 00000100:00100000:3.0:1789480028.009110:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789480028.009121:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551947648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480028.009276:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551947776:0@lo:400:kworker.0 00000100:00100000:0.0:1789480028.014141:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551947136:0@lo:400:kworker.0 00000100:00080000:0.0:1789480028.014252:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480028.014937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480028.014986:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947776 00000100:00100000:0.0:1789480028.014996:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947776 00000100:00100000:0.0:1789480028.015137:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789480028.015148:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551947776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480028.015219:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551947776:12345-0@lo:400:kworker.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480028.015227:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789480028.015251:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480028.015540:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551947648:12345-0@lo:400:kworker.0 Request processed in 6420us (6591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480028.015550:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1789480028.016543:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22aea98e00 x1876405551947776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480028.016562:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551947776:0@lo:400:kworker.0 00000100:00100000:0.0:1789480028.016608:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551947648:0@lo:400:kworker.0 00010000:00010000:3.0:1789480028.251428:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480028.509113:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480028.509157:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551947904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480028.509266:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480028.509739:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551947904 00000100:00100000:3.0:1789480028.509750:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551947904 00000100:00100000:3.0:1789480028.509941:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789480028.509954:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551947904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480028.510007:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480028.510079:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551947904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480028.510087:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789480028.510176:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4997b80 x1876405551947904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480028.510199:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551947904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480029.020974:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551948032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480029.021078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480029.021206:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948032 00000100:00100000:3.0:1789480029.021232:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948032 00000100:00100000:3.0:1789480029.021360:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000004:00080000:0.0:1789480029.021366:0:6808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322018080257ns, next at 323017601055ns, rc = 0 00000100:00100000:3.0:1789480029.021376:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551948032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789480029.021400:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789480029.021436:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480029.021597:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551948032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480029.021606:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789480029.022150:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba948700 x1876405551948032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480029.022189:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551948032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480029.274615:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480030.309379:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480031.066840:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551948288:0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.066862:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551948416:0@lo:400:kworker.0 00000100:00100000:0.0:1789480031.066971:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551948544:0@lo:400:kworker.0 00000100:00100000:2.0:1789480031.067928:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551948160:0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.073597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480031.073747:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480031.073762:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551948800:0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.073849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480031.073902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948416 00000100:00100000:1.0:1789480031.073914:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948416 00000100:00100000:1.0:1789480031.073998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789480031.074008:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551948416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480031.074030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480031.074087:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551948416:12345-0@lo:400:kworker.0 Request processed in 80us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480031.074096:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789480031.074107:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948288 00000100:00100000:3.0:1789480031.074113:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948288 00000100:00100000:3.0:1789480031.074147:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789480031.074153:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551948416:0@lo:400:kworker.0 00000100:00100000:3.0:1789480031.074157:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551948288:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789480031.074192:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480031.074206:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551948288:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480031.074214:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789480031.074238:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948800 00000100:00100000:1.0:1789480031.074242:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948800 00000100:00100000:3.0:1789480031.074257:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551948288:0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.074323:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789480031.074331:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551948800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.074370:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551948800:12345-0@lo:400:kworker.0 Request processed in 40us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480031.074377:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789480031.076022:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789480031.076077:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a48ad500 x1876405551948800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480031.076124:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551948800:0@lo:400:kworker.0 00000100:00100000:0.0:1789480031.076336:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480031.076689:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948544 00000100:00100000:3.0:1789480031.076700:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948544 00000100:00100000:3.0:1789480031.076832:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789480031.076843:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551948544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480031.076915:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551948544:12345-0@lo:400:kworker.0 Request processed in 75us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480031.076923:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789480031.077026:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd785c00 x1876405551948544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480031.077039:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551948544:0@lo:400:kworker.0 00000100:00080000:1.0:1789480031.077972:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480031.078619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480031.078709:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551948672:0@lo:400:kworker.0 00000100:00100000:0.0:1789480031.078725:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948160 00000100:00100000:0.0:1789480031.078735:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948160 00000100:00100000:2.0:1789480031.078755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480031.078806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789480031.078818:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551948160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480031.078883:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551948160:12345-0@lo:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480031.078890:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789480031.078993:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551948160:0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.079126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948672 00000100:00100000:1.0:1789480031.079130:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948672 00000100:00100000:1.0:1789480031.079186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789480031.079194:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551948672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480031.079247:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551948672:12345-0@lo:400:kworker.0 Request processed in 54us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480031.079253:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789480031.079363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551948672:0@lo:400:kworker.0 00000100:00080000:3.0:1789480031.079418:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480031.330995:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789480031.666136:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789480031.666164:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789480031.666179:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789480031.677938:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480031.677963:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551948928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789480031.678067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480031.678155:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551948928 00000100:00100000:0.0:1789480031.678163:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551948928 00000100:00100000:0.0:1789480031.679532:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789480031.679546:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551948928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789480031.679578:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789480031.679636:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa94c5a, atime: 0x6aa94c5a, ctime: 0x6aa94c5a, blocks: 0x1 00010000:00010000:0.0:1789480031.679645:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.679689:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1789480031.679693:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480031.679699:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.679716:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.679727:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.679735:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.679758:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789480031.683883:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405551948928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4328us (5805us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789480031.683900:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789480031.683952:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480031.683961:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.683973:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480031.683978:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.684008:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.684027:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.684034:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8acb738/0xbb972366037fd6a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480031.684058:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480031.684060:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480031.684062:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789480031.685466:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bd785c00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789480031.685481:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551948928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789480032.121264:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480032.121369:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480032.121420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480032.121468:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480032.121524:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746752 00000100:00100000:3.0:1789480032.121538:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746752 00000100:00100000:3.0:1789480032.121625:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747008 00000100:00100000:3.0:1789480032.121630:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747008 00000100:00100000:3.0:1789480032.130510:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789480032.130543:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526746752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480032.130702:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526746752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 176us (9456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.130712:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789480032.130746:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:3.0:1789480032.130754:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526747008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480032.130784:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526747008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (9418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.130790:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:3.0:1789480032.141387:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746624 00000100:00100000:3.0:1789480032.141410:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746624 00000100:00100000:3.0:1789480032.141508:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:3.0:1789480032.141521:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526746624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480032.141632:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526746624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 113us (20212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.141640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 254 00000100:00100000:3.0:1789480032.141731:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526746880 00000100:00100000:3.0:1789480032.141736:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526746880 00000100:00100000:3.0:1789480032.141780:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1789480032.141788:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526746880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480032.141826:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526746880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (20361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.141832:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:3.0:1789480032.141853:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480032.141859:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789480032.179879:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:02000400:0.0:1789480032.213786:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789480032.347555:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480033.372112:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789480033.479977:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfddc9c10 20000000:00000080:1.0:1789480033.479997:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22babcec00 uarg=0000000000000000 20000000:01000000:1.0:1789480033.480046:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789480033.480054:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789480033.480059:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789480033.485107:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789480033.485322:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789480033.495936:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789480033.495990:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789480033.496041:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789480033.496061:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789480033.496084:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496106:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496114:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496123:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd556 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496130:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd564 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496137:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd572 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496144:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496184:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496200:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 18 pid: 5823 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.496229:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949056:0@lo:104: 00000100:00100000:2.0:1789480033.496321:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480033.496667:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.496676:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 18 pid: 5824 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.496684:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949184:0@lo:104: 00000100:00100000:2.0:1789480033.496706:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480033.499592:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.499609:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 18 pid: 5825 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.499634:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949312:0@lo:104: 00000100:00100000:2.0:1789480033.499715:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480033.504113:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949056 00000100:00100000:0.0:1789480033.504129:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949056 00000100:00100000:0.0:1789480033.504204:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949184 00000100:00100000:0.0:1789480033.504208:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949184 00000100:00100000:0.0:1789480033.504233:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480033.504243:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:11675:x1876405551949056:12345-0@lo:104: 00010000:00010000:0.0:1789480033.504261:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480033.504676:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480033.504683:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+4:11675:x1876405551949056:12345-0@lo:104: Request processed in 442us (8362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480033.504713:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480033.504732:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480033.504739:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:11675:x1876405551949184:12345-0@lo:104: 00010000:00010000:0.0:1789480033.504749:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480033.504787:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789480033.504792:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:11675:x1876405551949184:12345-0@lo:104: Request processed in 54us (8085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480033.504797:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789480033.504947:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480033.504955:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.504962:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480033.504966:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.504975:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480033.504992:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480033.504997:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480033.505043:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505049:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480033.505072:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505079:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2146a00/0xbb972366037fd572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd579 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505091:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480033.505094:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505100:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffe00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480033.505102:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505109:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480033.505115:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480033.505120:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480033.505138:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505144:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480033.505150:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505155:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fd564 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd56b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505164:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480033.505165:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480033.505166:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480033.505180:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551949440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480033.505234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480033.505299:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480033.505307:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551949568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480033.505345:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480033.505379:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949440 00000100:00100000:1.0:1789480033.505383:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949440 00010000:00010000:1.0:1789480033.505404:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 19 pid: 5823 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480033.505422:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949568 00000100:00100000:1.0:1789480033.505425:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949568 00010000:00010000:1.0:1789480033.505433:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 20 pid: 5824 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480033.505449:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789480033.505455:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+20:3300:x1876405551949440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480033.505473:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480033.505478:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 20 pid: 5823 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505490:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 20 pid: 5823 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505508:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480033.505533:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+20:3300:x1876405551949440:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.505539:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789480033.505551:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480033.505556:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551949568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480033.505562:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480033.505566:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 19 pid: 5824 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505575:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 19 pid: 5824 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.505583:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480033.505600:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551949568:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.505606:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480033.505659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551949568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480033.505667:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551949440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480033.508377:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480033.508804:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.508824:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 12 pid: 5825 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.508838:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288eda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949696:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480033.508942:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480033.508963:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.508972:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949824:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480033.508996:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d780 going to sleep for 11 seconds 00010000:00010000:2.0:1789480033.509022:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5200/0xbb972366037fd579 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd572 expref: 18 pid: 5823 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.509037:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949056:0@lo:104: 00010000:00010000:2.0:1789480033.509048:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd56b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd564 expref: 17 pid: 5824 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.509056:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949184:0@lo:104: 00000100:00100000:0.0:1789480033.510431:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789480033.510461:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949312 00000100:00100000:0.0:1789480033.510469:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949312 00000100:00100000:0.0:1789480033.510522:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789480033.510531:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:11675:x1876405551949312:12345-0@lo:104: 00010000:00010000:0.0:1789480033.510546:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480033.510633:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480033.510638:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e677fecc-98d9-457e-99be-c06439303d19+3:11675:x1876405551949312:12345-0@lo:104: Request processed in 110us (10936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480033.510644:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789480033.510688:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480033.510716:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.510724:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480033.510728:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.510737:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480033.510744:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480033.510750:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480033.510788:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.510795:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480033.510819:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.510827:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22baffe800/0xbb972366037fd556 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fd55d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.510847:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480033.510849:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480033.510851:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480033.510865:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551949952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480033.510901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480033.510958:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551949952 00000100:00100000:1.0:1789480033.510963:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551949952 00010000:00010000:1.0:1789480033.510990:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 17 pid: 5825 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480033.511012:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480033.511018:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551949952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480033.511028:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480033.511033:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 17 pid: 5825 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.511045:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 17 pid: 5825 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.511062:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480033.511086:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551949952:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.511092:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480033.511137:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551949952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480033.512058:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030400/0xbb972366037fd55d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fd556 expref: 16 pid: 5825 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.512072:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949312:0@lo:104: 00000100:00100000:0.0:1789480033.522643:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288eda300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949696:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480033.522667:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876405551949824:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480033.522730:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480033.525271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480033.525402:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480033.525511:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747136 00000100:00100000:1.0:1789480033.525525:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747136 00010000:00010000:1.0:1789480033.525572:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 13 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480033.525638:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747264 00000100:00100000:1.0:1789480033.525642:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747264 00010000:00010000:1.0:1789480033.525656:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 14 pid: 5825 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480033.525677:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480033.525686:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+14:2347:x1876405526747136:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789480033.525958:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1789480033.525968:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+14:2347:x1876405526747264:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480033.525985:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480033.525993:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 14 pid: 5825 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480033.526011:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 14 pid: 5825 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480033.526032:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280031c00/0xbb972366037fd54f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f313f expref: 14 pid: 5825 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480033.526051:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480033.526125:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526747264:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 159us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480033.526133:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:1.0:1789480033.526383:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480033.526389:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526400:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526410:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bafffa00/0xbb972366037fd548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3138 expref: 12 pid: 5823 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526421:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526431:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526446:0:8453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526453:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526459:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526464:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526469:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480033.526473:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526491:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526502:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480033.526512:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480033.526545:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:2347:x1876405526747136:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 860us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.526551:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00010000:00010000:0.0:1789480033.526743:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480033.526754:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480033.526760:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22baffe000/0xbb972366037fd6ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480033.627107:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480033.632943:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551950080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480033.633046:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480033.644814:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950080 00000100:00100000:0.0:1789480033.644829:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950080 00000100:00100000:1.0:1789480033.648189:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480033.648203:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551950080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480033.648243:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480033.648354:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551950080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (15307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.648361:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789480033.648406:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bfd92680 x1876405551950080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480033.648426:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551950080:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789480033.648553:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480034.139559:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480034.139594:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551950208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480034.139701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480034.139976:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950208 00000100:00100000:1.0:1789480034.139984:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950208 00000100:00100000:1.0:1789480034.140052:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789480034.140062:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551950208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480034.140098:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480034.140149:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551950208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480034.140170:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789480034.140448:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789480034.140454:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bd785c00, transno 4294967300 00000100:00100000:0.0:1789480034.140480:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551950208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789480034.141253:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480034.395451:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480035.248211:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480035.248337:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747392 00000100:00100000:1.0:1789480035.248352:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747392 00000100:00100000:1.0:1789480035.248435:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:1.0:1789480035.248449:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:5592:x1876405526747392:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480035.248548:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480035.248577:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd6b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f318c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.248629:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f318c expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.248643:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f318c expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.248654:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2a00, rc 0) 00000100:00100000:1.0:1789480035.248872:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526747392:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 426us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.248881:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 255 00000100:00100000:2.0:1789480035.259798:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480035.260668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747520 00000100:00100000:3.0:1789480035.260679:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747520 00000100:00100000:3.0:1789480035.260831:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:3.0:1789480035.260845:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526747520:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480035.261179:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526747520:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 337us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.261187:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 256 00000100:00100000:0.0:1789480035.276235:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480035.276422:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747648 00000100:00100000:3.0:1789480035.276433:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747648 00000100:00100000:3.0:1789480035.276506:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 257 00000100:00100000:3.0:1789480035.276517:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526747648:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480035.276798:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526747648:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 282us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.276807:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 257 10000000:01000000:0.0:1789480035.293149:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480035.293160:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22b9aa2800 from 7 10000000:01000000:0.0:1789480035.293165:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480035.293235:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.293247:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.293258:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480035.293320:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.293400:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.293497:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.293687:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950336 00000100:00100000:3.0:1789480035.293697:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950336 00000100:00100000:3.0:1789480035.293747:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789480035.293757:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+16:5827:x1876405551950336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480035.293772:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480035.293786:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd6c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd6bb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.293812:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd6bb expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.293838:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd6bb expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.293854:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5000, rc 0) 00000100:00100000:3.0:1789480035.293897:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.293904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789480035.294057:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480035.294073:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.294082:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480035.294140:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.294165:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.294261:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480035.294696:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950464 00000100:00100000:1.0:1789480035.294702:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950464 00000100:00100000:1.0:1789480035.294740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789480035.294747:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.295018:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.295025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789480035.295438:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.295486:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.295542:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480035.295576:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.295704:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950592 00000100:00100000:3.0:1789480035.295710:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950592 00000100:00100000:3.0:1789480035.295734:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789480035.295740:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480035.295916:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.295922:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789480035.296352:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.297111:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11689:1876405551950720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.297171:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.297223:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.297345:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950720 00000100:00100000:3.0:1789480035.297351:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950720 00000100:00100000:3.0:1789480035.297395:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789480035.297403:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:11689:x1876405551950720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480035.298700:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+17:11689:x1876405551950720:12345-0@lo:502:llog_process_th.0 Request processed in 1292us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.298711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789480035.299142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480035.299660:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11689:1876405551950720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480035.299702:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480035.299715:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480035.299718:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480035.299725:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d22b9aa2800 00000020:00000080:1.0:1789480035.299727:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789480035.299894:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11689:1876405551950848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.299951:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.299996:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.300561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747776 00000100:00100000:3.0:1789480035.300568:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747776 00000100:00100000:3.0:1789480035.300630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950848 00000100:00100000:3.0:1789480035.300634:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950848 00000100:00100000:3.0:1789480035.300653:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 262 00000100:00100000:3.0:1789480035.300661:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:9951:x1876405526747776:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480035.300926:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:9951:x1876405526747776:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 263us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.300940:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 262 00000100:00100000:3.0:1789480035.300970:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789480035.300976:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:11689:x1876405551950848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480035.301098:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:11689:x1876405551950848:12345-0@lo:502:llog_process_th.0 Request processed in 122us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.301105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789480035.302567:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11689:1876405551950848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480035.302621:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480035.302631:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480035.302634:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789480035.302639:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789480035.303069:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789480035.303093:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480035.303104:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.303115:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480035.303126:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480035.303129:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22a4535800 from 7 10000000:01000000:0.0:1789480035.303132:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480035.303164:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.303173:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.303181:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480035.303225:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.303333:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.303369:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98600 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.303845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551950976 00000100:00100000:3.0:1789480035.303852:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551950976 00000100:00100000:3.0:1789480035.303900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789480035.303908:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+17:5827:x1876405551950976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480035.303922:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480035.303937:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5800/0xbb972366037fd6d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd6c9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.303961:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5800/0xbb972366037fd6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd6c9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.303973:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5800/0xbb972366037fd6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd6c9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.303981:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5800, rc 0) 00000100:00100000:3.0:1789480035.304030:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4484850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551950976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.304037:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789480035.304403:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551950976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480035.304419:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.304428:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480035.304490:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.304536:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.304574:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.305703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951104 00000100:00100000:3.0:1789480035.305712:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951104 00000100:00100000:3.0:1789480035.305759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789480035.305778:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551951104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480035.306355:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4487850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551951104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 576us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.306364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789480035.306518:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.306566:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.306621:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.306647:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.306776:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951232 00000100:00100000:3.0:1789480035.306780:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951232 00000100:00100000:3.0:1789480035.306813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789480035.306946:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551951232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480035.307102:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551951232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.307109:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789480035.307146:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.308705:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11690:1876405551951360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.308779:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.308925:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951360 00000100:00100000:0.0:1789480035.308933:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951360 00000100:00100000:0.0:1789480035.308969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789480035.308977:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:11690:x1876405551951360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480035.309173:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+18:11690:x1876405551951360:12345-0@lo:502:llog_process_th.0 Request processed in 197us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.309180:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789480035.309444:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480035.309472:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11690:1876405551951360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480035.309681:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480035.309692:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480035.309694:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480035.309701:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d22a4535800 00000020:00000080:1.0:1789480035.309704:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789480035.309773:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11690:1876405551951488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.309812:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.311022:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:0.0:1789480035.311104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951488 00000100:00100000:0.0:1789480035.311111:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951488 00000100:00100000:0.0:1789480035.311166:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789480035.311176:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:11690:x1876405551951488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480035.313984:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4486850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+18:11690:x1876405551951488:12345-0@lo:502:llog_process_th.0 Request processed in 2800us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.313999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789480035.316064:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11690:1876405551951488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480035.316115:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480035.316125:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480035.316128:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789480035.316132:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789480035.316384:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789480035.316406:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480035.316417:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.316429:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480035.316439:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480035.316451:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22aea50800 from 7 10000000:01000000:0.0:1789480035.316454:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480035.316492:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.316501:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.316510:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480035.316535:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.316618:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.316660:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480035.316740:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951616 00000100:00100000:3.0:1789480035.316746:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951616 00000100:00100000:3.0:1789480035.316789:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789480035.316797:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+18:5827:x1876405551951616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480035.316809:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480035.316897:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd6de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fd6d7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.316923:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd6de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fd6d7 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.316943:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd6de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fd6d7 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.316951:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4000, rc 0) 00000100:00100000:3.0:1789480035.316992:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551951616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480035.316998:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789480035.319858:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480035.319889:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480035.319903:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480035.319980:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480035.319987:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.320021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526747904 00000100:00100000:2.0:1789480035.320029:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526747904 00000100:00100000:0.0:1789480035.320039:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480035.320066:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951744 00000100:00100000:2.0:1789480035.320070:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951744 00000100:00100000:0.0:1789480035.320075:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480035.320092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 270 00000100:00100000:2.0:1789480035.320102:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:9951:x1876405526747904:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480035.320106:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789480035.320119:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551951744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.320446:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:9951:x1876405526747904:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 345us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480035.320454:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 270 00000100:00100000:0.0:1789480035.322730:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551951744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2607us (2684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.322757:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789480035.325772:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.326329:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480035.326416:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480035.326454:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480035.327098:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551951872 00000100:00100000:0.0:1789480035.327105:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551951872 00000100:00100000:0.0:1789480035.327166:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789480035.327175:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551951872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.327845:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:5827:x1876405551951872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 669us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.327854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789480035.328014:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e677fecc-98d9-457e-99be-c06439303d19:5827:1876405551951872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.337512:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11692:1876405551952000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480035.337621:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.337813:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480035.338337:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952000 00000100:00100000:2.0:1789480035.338346:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952000 00000100:00100000:2.0:1789480035.340815:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789480035.340835:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:11692:x1876405551952000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.340851:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480035.340882:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748032 00000100:00100000:1.0:1789480035.340889:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748032 00000100:00100000:1.0:1789480035.340915:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:1.0:1789480035.340923:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:5592:x1876405526748032:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480035.340934:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480035.340952:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22813d2600/0xbb972366037fd6e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3193 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.340977:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22813d2600/0xbb972366037fd6e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3193 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.340998:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22813d2600/0xbb972366037fd6e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3193 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480035.341008:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2600, rc 0) 00000100:00100000:1.0:1789480035.341067:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526748032:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 145us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.341075:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 274 00000100:00100000:2.0:1789480035.341108:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:11692:x1876405551952000:12345-0@lo:502:llog_process_th.0 Request processed in 280us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480035.341125:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000040:00080000:0.0:1789480035.341329:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480035.341795:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11692:1876405551952000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480035.341833:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480035.341842:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480035.341845:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480035.341851:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d22aea50800 00000020:00000080:0.0:1789480035.341853:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789480035.341942:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11692:1876405551952128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480035.341991:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480035.342028:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480035.342179:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952128 00000100:00100000:1.0:1789480035.342185:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952128 00000100:00100000:1.0:1789480035.342227:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789480035.342236:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:11692:x1876405551952128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480035.342552:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:11692:x1876405551952128:12345-0@lo:502:llog_process_th.0 Request processed in 317us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.342560:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789480035.342900:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e677fecc-98d9-457e-99be-c06439303d19:11692:1876405551952128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480035.342924:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480035.342931:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480035.342933:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789480035.342943:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789480035.343088:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789480035.343108:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480035.343118:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480035.343129:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480035.348468:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480035.348643:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748160 00000100:00100000:0.0:1789480035.348654:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748160 00000100:00100000:0.0:1789480035.348704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:0.0:1789480035.348716:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526748160:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480035.349059:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526748160:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 343us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.349068:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 276 00000100:00100000:2.0:1789480035.357534:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480035.358157:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748288 00000100:00100000:1.0:1789480035.358168:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748288 00000100:00100000:1.0:1789480035.358300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:1.0:1789480035.358311:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526748288:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480035.358597:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:5592:x1876405526748288:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 288us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.358615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:1.0:1789480035.365820:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480035.366186:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748416 00000100:00100000:2.0:1789480035.366202:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748416 00000100:00100000:2.0:1789480035.366322:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 278 00000100:00100000:2.0:1789480035.366336:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:9954:x1876405526748416:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480035.366698:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:9954:x1876405526748416:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 365us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480035.366709:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 278 00000100:00100000:2.0:1789480035.371427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480035.374650:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748544 00000100:00100000:0.0:1789480035.374665:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748544 00000100:00100000:0.0:1789480035.374750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:0.0:1789480035.374787:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:9954:x1876405526748544:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480035.375185:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:9954:x1876405526748544:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 425us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480035.376162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 279 00010000:00010000:0.0:1789480035.418552:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480036.187859:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551952512:0@lo:400:kworker.0 00000100:00100000:2.0:1789480036.187943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480036.188018:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789480036.188024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551952384:0@lo:400:kworker.0 00000100:00100000:2.0:1789480036.188049:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480036.188067:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551952896:0@lo:400:kworker.0 00000100:00100000:2.0:1789480036.188091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480036.188120:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952512 00000100:00100000:2.0:1789480036.188128:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952512 00000100:00100000:1.0:1789480036.188322:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551952640:0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480036.188383:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789480036.188389:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551952256:0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480036.188433:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551952768:0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480036.188484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952384 00000100:00100000:1.0:1789480036.188488:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952384 00000100:00100000:1.0:1789480036.188527:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952768 00000100:00100000:1.0:1789480036.188529:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952768 00000100:00100000:1.0:1789480036.188553:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789480036.188559:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551952384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188618:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551952384:12345-0@lo:400:kworker.0 Request processed in 58us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.188625:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789480036.188640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789480036.188646:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551952768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188671:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551952768:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.188676:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789480036.188707:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551952768:0@lo:400:kworker.0 00000100:00080000:1.0:1789480036.188737:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480036.188749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952256 00000100:00100000:1.0:1789480036.188752:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952256 00000100:00100000:1.0:1789480036.188775:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789480036.188781:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551952256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188813:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551952256:12345-0@lo:400:kworker.0 Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.188826:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789480036.188857:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551952256:0@lo:400:kworker.0 00000100:00100000:1.0:1789480036.188959:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551952384:0@lo:400:kworker.0 00000100:00100000:2.0:1789480036.189074:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789480036.189081:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551952512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480036.189118:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551952512:12345-0@lo:400:kworker.0 Request processed in 37us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480036.189124:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789480036.189279:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551952512:0@lo:400:kworker.0 00000100:00100000:3.0:1789480036.191052:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952896 00000100:00100000:3.0:1789480036.191062:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952896 00000100:00100000:3.0:1789480036.191116:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551952640 00000100:00100000:3.0:1789480036.191119:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551952640 00000100:00100000:3.0:1789480036.191168:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789480036.191176:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551952896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480036.191265:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551952896:12345-0@lo:400:kworker.0 Request processed in 90us (3172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480036.191272:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789480036.191322:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789480036.191329:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551952640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480036.191368:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551952640:12345-0@lo:400:kworker.0 Request processed in 40us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480036.191386:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789480036.191437:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551952640:0@lo:400:kworker.0 00010000:00080000:3.0:1789480036.191471:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2288edb800 x1876405551952896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480036.191482:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551952896:0@lo:400:kworker.0 00000100:00080000:1.0:1789480036.191738:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480036.191742:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480036.191745:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789480036.379653:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480036.443103:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480037.239515:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480037.239577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480037.239640:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480037.239688:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480037.239722:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748672 00000100:00100000:3.0:1789480037.239726:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748928 00000100:00100000:3.0:1789480037.239737:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748928 00000100:00100000:0.0:1789480037.239737:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748672 00000100:00100000:0.0:1789480037.239817:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:3.0:1789480037.239818:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1789480037.239831:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526748928:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480037.239835:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526748672:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480037.239929:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526748672:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480037.239938:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:0.0:1789480037.240001:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526748800 00000100:00100000:0.0:1789480037.240005:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526748800 00000100:00100000:0.0:1789480037.240053:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749056 00000100:00100000:0.0:1789480037.240057:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749056 00000100:00100000:0.0:1789480037.240083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1789480037.240090:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526748800:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480037.240125:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526748800:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480037.240132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1789480037.240145:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789480037.240153:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526749056:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480037.240179:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526749056:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480037.240186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1789480037.241514:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526748928:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1675us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480037.241527:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00080000:1.0:1789480037.242751:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480037.242761:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480037.470730:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480038.491954:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480038.746602:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551953024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480038.746702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480038.746770:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953024 00000100:00100000:1.0:1789480038.746782:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953024 00000100:00100000:1.0:1789480038.746870:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480038.746882:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551953024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480038.746931:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480038.746997:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551953024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480038.747006:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789480038.747074:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789480038.747144:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4976300 x1876405551953024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480038.747167:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551953024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480039.258703:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551953152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480039.258807:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480039.259047:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953152 00000100:00100000:0.0:1789480039.259062:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953152 00000100:00100000:0.0:1789480039.259153:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480039.259167:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551953152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480039.259221:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789480039.259549:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480039.262580:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551953152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3401us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480039.262598:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789480039.262771:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551953152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480039.515901:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480040.542869:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480041.306902:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551953408:0@lo:400:kworker.0 00000100:00100000:2.0:1789480041.306953:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551953280:0@lo:400:kworker.0 00000100:00100000:0.0:1789480041.307011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480041.307027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480041.307122:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551953664:0@lo:400:kworker.0 00000100:00100000:1.0:1789480041.307161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480041.307213:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551953536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480041.307240:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480041.307348:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551953792:0@lo:400:kworker.0 00000100:00100000:2.0:1789480041.307378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480041.307434:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953664 00000100:00100000:3.0:1789480041.307446:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953664 00000100:00100000:2.0:1789480041.307447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953280 00000100:00100000:2.0:1789480041.307453:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953280 00000100:00100000:3.0:1789480041.307535:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789480041.307549:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551953664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.307626:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551953664:12345-0@lo:400:kworker.0 Request processed in 80us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.307636:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789480041.307667:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480041.307685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953408 00000100:00100000:3.0:1789480041.307690:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953408 00000100:00100000:3.0:1789480041.307717:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953536 00000100:00100000:3.0:1789480041.307720:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953536 00000100:00100000:3.0:1789480041.307740:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953792 00000100:00100000:3.0:1789480041.307743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953792 00000100:00100000:3.0:1789480041.307759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480041.307765:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551953408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.307801:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551953408:12345-0@lo:400:kworker.0 Request processed in 36us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.307807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480041.307821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789480041.307828:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551953536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.307863:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551953536:12345-0@lo:400:kworker.0 Request processed in 36us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.307881:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789480041.307895:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789480041.307902:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551953792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.307938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551953792:12345-0@lo:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.307945:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789480041.307961:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480041.308010:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551953664:0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.308077:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551953792:0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.308120:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551953536:0@lo:400:kworker.0 00000100:00100000:2.0:1789480041.308207:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789480041.308217:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551953280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480041.308265:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551953280:12345-0@lo:400:kworker.0 Request processed in 51us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480041.308271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789480041.308333:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551953280:0@lo:400:kworker.0 00000100:00100000:0.0:1789480041.318508:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551953408:0@lo:400:kworker.0 00000100:00100000:0.0:1789480041.318532:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551953920:0@lo:400:kworker.0 00000100:00100000:0.0:1789480041.318651:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480041.318783:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551953920 00000100:00100000:3.0:1789480041.318795:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551953920 00000100:00100000:3.0:1789480041.318893:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789480041.318905:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551953920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480041.318983:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551953920:12345-0@lo:400:kworker.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.318993:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789480041.319005:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789480041.319038:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba43b800 x1876405551953920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480041.319137:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551953920:0@lo:400:kworker.0 00010000:00010000:0.0:1789480041.562694:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480042.355021:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480042.355181:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480042.355220:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480042.355253:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749440 00000100:00100000:0.0:1789480042.355267:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749440 00000100:00100000:1.0:1789480042.355359:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749184 00000100:00100000:1.0:1789480042.355381:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749184 00000100:00100000:1.0:1789480042.355456:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:1.0:1789480042.355470:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526749184:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480042.355491:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789480042.355504:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749440:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480042.355576:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749440:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480042.355584:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00080000:0.0:1789480042.355622:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480042.355804:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526749184:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 336us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480042.355812:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:0.0:1789480042.358266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480042.359954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749312 00000100:00100000:2.0:1789480042.359972:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749312 00000100:00080000:0.0:1789480042.360049:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480042.360064:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749568 00000100:00100000:2.0:1789480042.360067:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749568 00000100:00100000:2.0:1789480042.360112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:2.0:1789480042.360122:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749312:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:0.0:1789480042.360135:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480042.360248:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749312:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 127us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480042.360743:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:1.0:1789480042.360755:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526749568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480042.360842:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526749568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 89us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480042.360850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:2.0:1789480042.360895:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00010000:00010000:1.0:1789480042.586853:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480043.611844:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480043.871690:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480043.871717:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551954048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480043.871810:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480043.871983:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954048 00000100:00100000:2.0:1789480043.871996:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954048 00000100:00100000:2.0:1789480043.872081:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789480043.872095:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551954048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480043.872146:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480043.872216:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551954048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.872223:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789480043.873239:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789480043.873279:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba439180 x1876405551954048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480043.873338:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551954048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480044.378606:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551954176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480044.378688:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480044.378856:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954176 00000100:00100000:0.0:1789480044.378864:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954176 00000100:00100000:0.0:1789480044.385051:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789480044.386457:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551954176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480044.386505:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480044.386607:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551954176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (7919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.386615:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789480044.386647:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480044.387240:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551954176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789480044.634821:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480045.661697:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480046.427406:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551954560:0@lo:400:kworker.0 00000100:00100000:2.0:1789480046.427990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480046.428095:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789480046.428104:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551954432:0@lo:400:kworker.0 00000100:00100000:2.0:1789480046.428133:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480046.428154:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551954944:0@lo:400:kworker.0 00000100:00100000:2.0:1789480046.428185:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480046.428322:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551954688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480046.428358:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480046.428407:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789480046.428416:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551954304:0@lo:400:kworker.0 00000100:00100000:3.0:1789480046.428460:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480046.428496:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551954816:0@lo:400:kworker.0 00000100:00100000:3.0:1789480046.428563:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480046.428620:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954944 00000100:00100000:3.0:1789480046.428633:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954944 00000100:00100000:3.0:1789480046.429125:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954688 00000100:00100000:3.0:1789480046.429130:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954688 00000100:00100000:3.0:1789480046.429161:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789480046.429193:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551954944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480046.429393:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789480046.429405:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551954688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480046.429457:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551954688:12345-0@lo:400:kworker.0 Request processed in 55us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480046.429464:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789480046.429498:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954560 00000100:00100000:1.0:1789480046.429503:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954560 00000100:00100000:1.0:1789480046.429534:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954432 00000100:00100000:1.0:1789480046.429537:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954432 00000100:00100000:1.0:1789480046.429551:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954816 00000100:00100000:1.0:1789480046.429554:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954816 00000100:00100000:1.0:1789480046.429569:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789480046.429575:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551954560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480046.429771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789480046.429781:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551954432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789480046.429846:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480046.429852:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480046.429855:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480046.429876:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551954304 00000100:00100000:0.0:1789480046.429880:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551954304 00000100:00100000:0.0:1789480046.429914:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789480046.429921:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551954304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480046.429959:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551954304:12345-0@lo:400:kworker.0 Request processed in 39us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480046.429965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789480046.430051:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551954304:0@lo:400:kworker.0 00000100:00100000:0.0:1789480046.430069:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551954688:0@lo:400:kworker.0 00000100:00100000:0.0:1789480046.430107:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789480046.430117:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789480046.430264:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789480046.430272:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551954816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480046.430337:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551954816:12345-0@lo:400:kworker.0 Request processed in 66us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480046.430353:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789480046.431259:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551954944:12345-0@lo:400:kworker.0 Request processed in 2061us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480046.431273:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789480046.431819:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551954816:0@lo:400:kworker.0 00000100:00100000:3.0:1789480046.435991:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551954432:0@lo:400:kworker.0 00010000:00080000:3.0:1789480046.436021:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2288edb100 x1876405551954944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480046.436033:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551954944:0@lo:400:kworker.0 00000100:00100000:3.0:1789480046.436046:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551954560:0@lo:400:kworker.0 00000100:00100000:2.0:1789480046.436160:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551954432:12345-0@lo:400:kworker.0 Request processed in 6378us (8022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480046.436175:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789480046.437662:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551954560:12345-0@lo:400:kworker.0 Request processed in 8072us (9659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480046.437679:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000040:00080000:3.0:1789480046.624233:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480046.683099:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480047.478249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480047.478403:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749696 00000100:00100000:1.0:1789480047.478422:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749696 00000100:00100000:1.0:1789480047.478518:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:1.0:1789480047.478554:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526749696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480047.478659:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526749696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 130us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480047.478670:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:0.0:1789480047.492795:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480047.496458:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749824 00000100:00100000:3.0:1789480047.496484:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749824 00000100:00100000:3.0:1789480047.496680:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1789480047.496696:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749824:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480047.496827:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526749824:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 138us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480047.496836:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00080000:0.0:1789480047.497547:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480047.512193:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480047.512258:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480047.513067:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526749952 00000100:00100000:1.0:1789480047.513078:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526749952 00000100:00100000:1.0:1789480047.513165:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1789480047.513177:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2344:x1876405526749952:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1789480047.513211:0:8279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd621 00000100:00080000:1.0:1789480047.513223:0:8279:0:(import.c:65:import_set_state_nolock()) ffff8d22a4911000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480047.513264:0:8279:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789480047.513514:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480047.513568:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480047.513839:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+2:2344:x1876405526749952:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 663us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480047.513848:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789480047.515735:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750080 00000100:00100000:0.0:1789480047.515751:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750080 00000100:00100000:0.0:1789480047.515843:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:0.0:1789480047.515853:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526750080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480047.515962:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526750080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 111us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480047.515970:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00080000:2.0:1789480047.516100:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480047.706611:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480048.730679:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480048.987607:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480048.987689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480048.987979:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955072 00000100:00100000:3.0:1789480048.987989:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955072 00000100:00080000:2.0:1789480048.988106:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480048.988886:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789480048.988902:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551955072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480048.988944:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480048.989035:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551955072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.989056:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1789480048.989152:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba439f80 x1876405551955072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480048.989173:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480049.508186:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480049.508224:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551955200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480049.508356:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480049.508510:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955200 00000100:00100000:0.0:1789480049.508519:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955200 00000100:00100000:0.0:1789480049.508596:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789480049.508607:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551955200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480049.508646:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480049.508693:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551955200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480049.508700:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789480049.508789:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551955200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789480049.509048:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789480049.755129:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480050.780625:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480051.547704:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551955584:0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.547785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480051.547970:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551955712:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548003:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480051.548034:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789480051.548040:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551955328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480051.548117:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551955840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548140:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480051.548177:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955712 00000100:00100000:0.0:1789480051.548185:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955712 00000100:00100000:0.0:1789480051.548241:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789480051.548249:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551955712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548347:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551955712:12345-0@lo:400:kworker.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.548354:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789480051.548381:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955328 00000100:00100000:0.0:1789480051.548385:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955328 00000100:00100000:0.0:1789480051.548412:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789480051.548418:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551955328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548450:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551955328:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.548457:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789480051.548485:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955584 00000100:00100000:0.0:1789480051.548488:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955584 00000100:00100000:0.0:1789480051.548517:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955840 00000100:00100000:0.0:1789480051.548520:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955840 00000100:00100000:0.0:1789480051.548539:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480051.548545:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551955584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548576:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551955584:12345-0@lo:400:kworker.0 Request processed in 32us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.548582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480051.548593:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789480051.548599:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551955840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548636:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551955840:12345-0@lo:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.548642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1789480051.548669:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480051.548675:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480051.548698:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551955328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548711:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551955840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.548718:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551955712:0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.549482:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551955584:0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.549501:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789480051.549509:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551955456:0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.549550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480051.549593:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551955968:0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.549616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480051.549650:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955968 00000100:00100000:2.0:1789480051.549654:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955968 00000100:00100000:2.0:1789480051.549746:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789480051.549753:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551955968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480051.549794:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551955968:12345-0@lo:400:kworker.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480051.549800:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789480051.549815:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789480051.549837:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a4bb5880 x1876405551955968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480051.550425:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551955968:0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.550800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551955456 00000100:00100000:0.0:1789480051.550806:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551955456 00000100:00100000:0.0:1789480051.550863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789480051.550872:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551955456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480051.551176:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551955456:12345-0@lo:400:kworker.0 Request processed in 306us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.551184:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789480051.551279:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551955456:0@lo:400:kworker.0 00010000:00010000:1.0:1789480051.802580:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480052.600738:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480052.600793:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480052.600835:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480052.600979:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750464 00000100:00100000:1.0:1789480052.601010:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750464 00000100:00100000:1.0:1789480052.601086:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750336 00000100:00100000:1.0:1789480052.601090:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750336 00000100:00100000:1.0:1789480052.601118:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:1.0:1789480052.601129:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526750464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480052.601225:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526750464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 97us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480052.601232:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:1.0:1789480052.601264:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1789480052.601272:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526750336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480052.601330:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526750336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 59us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480052.601337:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00080000:2.0:1789480052.601597:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480052.603110:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750208 00000100:00100000:0.0:1789480052.603132:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750208 00000100:00100000:0.0:1789480052.603243:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:0.0:1789480052.603271:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526750208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480052.603425:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526750208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 161us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480052.603450:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00000001:00100000:1.0:1789480052.708239:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:1.0:1789480052.708263:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d22a4913000/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:3.0:1789480052.708360:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4913000/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-OST0000 00000020:00000080:3.0:1789480052.708819:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22a4911000 for lustre-OST0000 00010000:00010000:3.0:1789480052.826678:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480053.854045:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480054.107004:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480054.107039:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551956096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480054.107136:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480054.107264:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956096 00000100:00100000:3.0:1789480054.107275:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956096 00000100:00100000:3.0:1789480054.107383:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789480054.107393:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551956096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480054.107439:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480054.107497:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551956096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480054.107505:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789480054.107566:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba439880 x1876405551956096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480054.107588:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551956096:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789480054.107832:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480054.618651:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480054.618685:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551956224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480054.618803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480054.618985:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956224 00000100:00100000:3.0:1789480054.618996:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956224 00000100:00100000:3.0:1789480054.619071:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789480054.619084:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551956224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480054.619135:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480054.619193:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551956224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480054.619201:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789480054.619248:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480054.622506:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551956224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480054.877750:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480055.898639:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480056.670783:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551956736:0@lo:400:kworker.0 00000100:00100000:1.0:1789480056.670894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.671075:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551956352:0@lo:400:kworker.0 00000100:00100000:1.0:1789480056.671197:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551956480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.672382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.672461:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551956864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.672504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.672569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956864 00000100:00100000:0.0:1789480056.672580:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956864 00000100:00100000:3.0:1789480056.672879:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956352 00000100:00100000:3.0:1789480056.672884:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956352 00000100:00100000:3.0:1789480056.673017:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789480056.673030:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551956352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480056.673116:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551956352:12345-0@lo:400:kworker.0 Request processed in 88us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480056.673123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789480056.673730:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.674081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956480 00000100:00100000:0.0:1789480056.674088:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956480 00000100:00100000:0.0:1789480056.674121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789480056.674131:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551956864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480056.674217:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551956992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.675184:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551956864:12345-0@lo:400:kworker.0 Request processed in 1050us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.675196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789480056.675240:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789480056.675253:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551956480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.675309:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551956480:12345-0@lo:400:kworker.0 Request processed in 62us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.675316:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789480056.675353:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480056.675402:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551956352:0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.675421:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551956864:0@lo:400:kworker.0 00000100:00100000:3.0:1789480056.676519:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551956608:0@lo:400:kworker.0 00000100:00100000:3.0:1789480056.676609:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.677773:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956608 00000100:00100000:0.0:1789480056.677787:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956608 00000100:00100000:0.0:1789480056.677882:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789480056.677893:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551956608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.677998:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551956608:12345-0@lo:400:kworker.0 Request processed in 107us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.678006:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789480056.678073:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551956608:0@lo:400:kworker.0 00000100:00080000:3.0:1789480056.678243:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480056.679101:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956736 00000100:00100000:0.0:1789480056.679111:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956736 00000100:00100000:0.0:1789480056.679824:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789480056.679842:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551956736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.680109:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551956736:12345-0@lo:400:kworker.0 Request processed in 275us (9215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.680119:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789480056.680997:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551956736:0@lo:400:kworker.0 00000100:00100000:1.0:1789480056.681250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480056.681331:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551956480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.682574:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551956992 00000100:00100000:0.0:1789480056.682585:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551956992 00000100:00080000:3.0:1789480056.688196:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480056.688252:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480056.688584:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789480056.688715:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551956992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480056.689340:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551956992:12345-0@lo:400:kworker.0 Request processed in 743us (8089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.689351:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1789480056.692516:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22a452dc00 x1876405551956992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480056.692542:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551956992:0@lo:400:kworker.0 00000040:00080000:3.0:1789480056.864202:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480056.922990:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480057.712921:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480057.712980:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480057.713020:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750848 00000100:00100000:3.0:1789480057.713033:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750848 00000100:00100000:2.0:1789480057.713682:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1789480057.713702:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526750848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480057.714317:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526750848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 589us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480057.714328:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00080000:2.0:1789480057.714372:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480057.714612:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750592 00000100:00100000:1.0:1789480057.714620:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750592 00000100:00100000:1.0:1789480057.714672:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:1.0:1789480057.714680:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526750592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480057.714713:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526750592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480057.714720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:1.0:1789480057.714884:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480057.715021:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750720 00000100:00100000:1.0:1789480057.715026:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750720 00000100:00100000:1.0:1789480057.715062:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:1.0:1789480057.715069:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526750720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480057.717719:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526750720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480057.717739:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00010000:00010000:2.0:1789480057.947714:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480058.450081:0:11858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:47:37 (1789480057) 00010000:00010000:3.0:1789480058.971370:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480059.226653:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551957120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480059.226742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480059.229208:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957120 00000100:00100000:3.0:1789480059.229223:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957120 00000100:00100000:3.0:1789480059.229382:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789480059.229395:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551957120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480059.229446:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480059.229552:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551957120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480059.229560:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789480059.229685:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22ba439c00 x1876405551957120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480059.229708:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551957120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789480059.229792:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480059.738789:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480059.742451:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551957248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480059.742542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480059.751912:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957248 00000100:00100000:3.0:1789480059.751960:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957248 00000100:00100000:3.0:1789480059.752148:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789480059.752160:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551957248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480059.752205:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480059.752334:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551957248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (9791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480059.752342:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789480059.752830:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551957248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789480059.766074:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480059.995899:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480060.504191:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480060.504469:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526750976 00000100:00100000:2.0:1789480060.504482:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526750976 00000100:00100000:2.0:1789480060.504570:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789480060.504585:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:10225:x1876405526750976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480060.504607:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480060.504632:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fd6ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f319a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789480060.504771:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480060.504915:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.504931:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.504946:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480060.504991:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480060.504996:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480060.505043:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.505073:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fd6ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f319a expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.505105:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f319a expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.505113:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d900) 00010000:00010000:2.0:1789480060.505117:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480060.505120:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff600, rc 0) 00000100:00100000:2.0:1789480060.505193:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:10225:x1876405526750976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 615us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480060.505201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1789480060.510624:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480060.510730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751104 00000100:00100000:2.0:1789480060.510741:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751104 00000100:00100000:2.0:1789480060.510821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789480060.510831:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:10226:x1876405526751104:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480060.510853:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480060.510875:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fd6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.510948:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.510964:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.510976:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.510990:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.510996:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511003:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511259:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511269:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511276:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480060.511776:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480060.511781:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480060.511805:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511818:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511825:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511833:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511839:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480060.511844:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511852:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511865:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d900) 00010000:00010000:2.0:1789480060.511868:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480060.511873:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511880:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511891:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511908:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511915:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511919:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480060.511922:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511928:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511935:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d228804d700) 00010000:00010000:2.0:1789480060.511938:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480060.511941:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511947:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd708 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.511991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fd6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a1 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.512006:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a1 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480060.512013:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d228804db00) 00010000:00010000:2.0:1789480060.512016:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480060.512024:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffe00, rc 0) 00000100:00100000:2.0:1789480060.512162:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:10226:x1876405526751104:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1331us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480060.512171:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480060.516896:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480060.517010:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751360 00000100:00100000:0.0:1789480060.517022:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751360 00000100:00100000:0.0:1789480060.517099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1789480060.517111:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:10226:x1876405526751360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480060.517132:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480060.517166:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd716 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517322:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517336:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517418:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517426:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517801:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7000/0xbb972366037fd72b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517812:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7000/0xbb972366037fd72b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517820:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7000/0xbb972366037fd72b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480060.517832:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789480060.517990:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.517999:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518016:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518021:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480060.518025:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518033:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518047:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d228804db00) 00010000:00010000:0.0:1789480060.518050:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480060.518055:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518061:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fd71d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518074:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518080:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518085:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518099:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480060.518102:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518120:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518128:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2290ce3b00) 00010000:00010000:0.0:1789480060.518130:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480060.518134:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518140:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd724 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518677:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd716 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a8 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518693:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7000/0xbb972366037fd72b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a8 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480060.518700:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480060.518702:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480060.518705:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7000, rc 0) 00000100:00100000:0.0:1789480060.518801:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10226:x1876405526751360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1691us (1916us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789480060.518811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1789480060.527938:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480060.528051:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751488 00000100:00100000:2.0:1789480060.528062:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751488 00000100:00100000:2.0:1789480060.528134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1789480060.528145:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10226:x1876405526751488:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789480060.528455:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10226:x1876405526751488:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480060.528463:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000040:00080000:1.0:1789480060.956651:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789480061.019873:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480061.786626:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551957632:0@lo:400:kworker.0 00000100:00100000:2.0:1789480061.786657:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551957760:0@lo:400:kworker.0 00000100:00100000:0.0:1789480061.786738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480061.786808:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551957376:0@lo:400:kworker.0 00000100:00100000:3.0:1789480061.786926:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551957504:0@lo:400:kworker.0 00000100:00100000:2.0:1789480061.786960:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480061.787127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480061.787173:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551957888:0@lo:400:kworker.0 00000100:00100000:1.0:1789480061.787202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480061.787497:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957376 00000100:00100000:2.0:1789480061.787510:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957376 00000100:00100000:0.0:1789480061.787538:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957632 00000100:00100000:0.0:1789480061.787543:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957632 00000100:00100000:2.0:1789480061.787577:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789480061.787591:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551957376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480061.787605:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957888 00000100:00100000:0.0:1789480061.787609:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957888 00000100:00100000:0.0:1789480061.787636:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789480061.787642:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551957632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480061.787664:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551957376:12345-0@lo:400:kworker.0 Request processed in 76us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480061.787683:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551957632:12345-0@lo:400:kworker.0 Request processed in 42us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.787684:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789480061.787689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789480061.787703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789480061.787709:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551957888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480061.790337:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551957376:0@lo:400:kworker.0 00000100:00080000:1.0:1789480061.791648:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480061.791696:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957760 00000100:00100000:1.0:1789480061.791881:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957760 00000100:00100000:1.0:1789480061.791975:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789480061.791990:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551957760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480061.793638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480061.793711:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551958016:0@lo:400:kworker.0 00000100:00100000:3.0:1789480061.793776:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480061.793846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551957504 00000100:00100000:3.0:1789480061.793856:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551957504 00000100:00100000:3.0:1789480061.793911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789480061.793920:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551957504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480061.793987:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551957504:12345-0@lo:400:kworker.0 Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480061.793995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789480061.794029:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551958016 00000100:00100000:3.0:1789480061.794033:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551958016 00000100:00100000:3.0:1789480061.794082:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789480061.794090:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551958016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480061.794123:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551958016:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480061.794129:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789480061.794174:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551957504:0@lo:400:kworker.0 00010000:00080000:3.0:1789480061.794205:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bafe6300 x1876405551958016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480061.794217:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551958016:0@lo:400:kworker.0 00000100:00100000:1.0:1789480061.795448:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551957760:12345-0@lo:400:kworker.0 Request processed in 3455us (8480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480061.795463:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789480061.795710:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480061.795718:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480061.796302:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551957888:12345-0@lo:400:kworker.0 Request processed in 8589us (9095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480061.796782:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551957888:0@lo:400:kworker.0 00000100:00100000:0.0:1789480061.796848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789480061.797077:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551957632:0@lo:400:kworker.0 00000100:00100000:2.0:1789480061.800836:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551957760:0@lo:400:kworker.0 00010000:00010000:3.0:1789480062.042634:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789480062.367482:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1789480062.832859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480062.832957:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480062.832993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751872 00000100:00100000:1.0:1789480062.833003:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751872 00000100:00100000:1.0:1789480062.833079:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:1.0:1789480062.833093:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526751872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480062.833178:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2347:x1876405526751872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480062.833186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00080000:1.0:1789480062.833209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480062.837749:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480062.838146:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751744 00000100:00100000:1.0:1789480062.838157:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751744 00000100:00100000:1.0:1789480062.838242:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:1.0:1789480062.838253:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526751744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480062.838374:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526751744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 122us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480062.838381:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00080000:3.0:1789480062.838825:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480062.839763:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526751616 00000100:00100000:0.0:1789480062.839772:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526751616 00000100:00100000:0.0:1789480062.841244:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:0.0:1789480062.841270:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526751616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480062.841392:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526751616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 133us (8544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480062.841399:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 291 00010000:00010000:1.0:1789480063.070449:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480063.213496:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480063.213672:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752000 00000100:00100000:2.0:1789480063.213684:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752000 00000100:00100000:2.0:1789480063.214339:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1789480063.214370:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10269:x1876405526752000:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480063.214422:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480063.215450:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215678:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215695:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215707:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215725:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215733:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215740:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215947:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215961:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215968:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215975:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.215979:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.215987:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.216431:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d900) 00010000:00010000:3.0:1789480063.216437:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.216443:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.216450:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.216465:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.216471:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217747:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217754:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.217769:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217777:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217789:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d22b7076800) 00010000:00010000:3.0:1789480063.217792:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.217795:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217802:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217858:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd739 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31af expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217868:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d900) 00010000:00010000:3.0:1789480063.217870:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.217874:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31af expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.217884:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480063.217952:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10269:x1876405526752000:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3596us (4475us total) trans 0 rc 301/301 00000100:00100000:3.0:1789480063.217961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1789480063.227353:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.227409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752256 00000100:00100000:3.0:1789480063.227422:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752256 00000100:00100000:3.0:1789480063.227487:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1789480063.227499:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10269:x1876405526752256:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:3.0:1789480063.227580:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480063.227611:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd6f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f319a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227641:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d900) 00010000:00010000:3.0:1789480063.227654:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480063.227928:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227944:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227956:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227968:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227975:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.227981:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480063.230856:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789480063.230877:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230888:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230896:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230909:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.230914:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230922:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230939:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480063.230942:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.230947:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.230952:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd74e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480063.230977:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086a22401 reply state 00000000a0d858ff transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480063.230986:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480063.231473:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10269:x1876405526752256:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 3971us (4126us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789480063.231483:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:2.0:1789480063.244529:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244550:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244558:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244565:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480063.244571:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244578:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244595:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d22b7076b00) 00010000:00010000:2.0:1789480063.244599:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480063.244603:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.244610:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fd755 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480063.397979:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480063.399071:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752384 00000100:00100000:2.0:1789480063.399081:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752384 00000100:00100000:2.0:1789480063.399153:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789480063.399165:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10277:x1876405526752384:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1789480063.399189:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480063.399440:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd75c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31b6 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399528:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399541:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399553:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480063.399601:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480063.399605:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480063.399647:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399673:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd75c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31b6 expref: 10 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399692:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31b6 expref: 9 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.399700:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:2.0:1789480063.399703:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480063.399707:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff600, rc 0) 00000100:00100000:2.0:1789480063.399775:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10277:x1876405526752384:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 614us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.399783:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1789480063.522144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.523096:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752512 00000100:00100000:3.0:1789480063.523109:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752512 00000100:00100000:3.0:1789480063.524041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480063.524056:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10283:x1876405526752512:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480063.524077:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480063.524098:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd76a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524198:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524213:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524224:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524238:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524244:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524250:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524382:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524391:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524397:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480063.524429:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789480063.524432:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480063.524473:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524495:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524501:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524507:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524513:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.524517:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524524:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524537:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:3.0:1789480063.524540:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.524545:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524562:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524576:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524581:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524587:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524597:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.524600:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524607:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524615:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d22b7076600) 00010000:00010000:3.0:1789480063.524617:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.524620:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524626:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd778 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524665:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd76a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31bd expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524692:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31bd expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.524700:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480063.524703:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480063.524705:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5200, rc 0) 00000100:00100000:3.0:1789480063.525645:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+10:10283:x1876405526752512:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1585us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480063.525655:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480063.529942:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480063.535881:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752768 00000100:00100000:0.0:1789480063.535901:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752768 00000100:00100000:0.0:1789480063.536216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1789480063.536228:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+10:10283:x1876405526752768:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480063.536252:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480063.536275:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd786 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31c4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536451:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536469:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536482:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536496:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536503:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.536525:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789480063.538914:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789480063.539129:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539147:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539159:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539200:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539219:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539226:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539232:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480063.539237:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539246:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539260:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480063.539263:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480063.539269:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd78d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480063.539474:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e6cc886 reply state 000000009cdaa3a2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480063.539484:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789480063.539529:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd786 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539543:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.539561:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:0.0:1789480063.539564:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480063.539567:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480063.539645:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10283:x1876405526752768:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3418us (9716us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789480063.539654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1789480063.554458:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480063.554961:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526752896 00000100:00100000:2.0:1789480063.554986:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526752896 00000100:00100000:2.0:1789480063.555054:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1789480063.555062:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1876405526752896:12345-192.168.204.54@tcp:8:bash.0 00010000:00080000:2.0:1789480063.555099:0:8279:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:2.0:1789480063.555136:0:8279:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fd7a9 00002000:00100000:2.0:1789480063.555148:0:8279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f712dbb2-3172-402a-b822-94513dd5b6e3/ffff8d22a4b4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789480063.555173:0:8279:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:3.0:1789480063.555269:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555306:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555315:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555322:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480063.555328:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555336:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555353:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2290ce3100) 00010000:00010000:3.0:1789480063.555357:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480063.555362:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.555369:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789480063.555463:0:8279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789480063.555501:0:8279:0:(import.c:65:import_set_state_nolock()) ffff8d2288f51000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480063.555582:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526752896:12345-192.168.204.54@tcp:8:bash.0 Request processed in 518us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.555590:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789480063.561543:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480063.561635:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526753024 00000100:00100000:0.0:1789480063.561645:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526753024 00000100:00100000:0.0:1789480063.561728:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480063.561740:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:0:x1876405526753024:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480063.561770:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480063.561796:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31cb expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480063.561827:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480063.561862:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1789480063.561867:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480063.561877:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.561902:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.561917:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6c00, rc 0) 00000100:00100000:0.0:1789480063.561987:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:0:x1876405526753024:12345-192.168.204.54@tcp:101:bash.0 Request processed in 249us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.562006:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:3.0:1789480063.562263:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480063.567655:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480063.567885:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526753152 00000100:00100000:2.0:1789480063.567896:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526753152 00000100:00100000:2.0:1789480063.567964:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480063.567976:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:10283:x1876405526753152:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480063.567995:0:8279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480063.568018:0:8279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31d2 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.568059:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.568070:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480063.568074:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480063.568081:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 8 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.568145:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.568161:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480063.568176:0:8279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551958144:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480063.568278:0:8279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d51e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480063.573534:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.573764:0:8279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551958144:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480063.573810:0:8279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 8 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.573847:0:8279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:3.0:1789480063.573947:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10283:x1876405526753152:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5973us (6304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480063.573957:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789480063.575025:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526753280 00000100:00100000:1.0:1789480063.575046:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526753280 00010000:00010000:1.0:1789480063.575088:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480063.575138:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1789480063.575148:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526753280:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480063.575163:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480063.575188:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.575203:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.575241:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d108b150/0xbb972366037fd7b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31cb expref: 8 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.575258:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480063.575262:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480063.575271:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.575345:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.575381:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480063.575396:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876405551958272:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480063.575470:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480063.578788:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876405551958272:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480063.578816:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480063.581310:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526753280:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6134us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480063.581325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1789480063.588716:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.589952:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526753536 00000100:00100000:3.0:1789480063.589967:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526753536 00000100:00100000:3.0:1789480063.590417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789480063.590430:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+12:10283:x1876405526753536:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789480063.591351:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10283:x1876405526753536:12345-192.168.204.54@tcp:35:bash.0 Request processed in 920us (2647us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789480063.591361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789480063.752155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.752536:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526753792 00000100:00100000:3.0:1789480063.752550:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526753792 00000100:00100000:3.0:1789480063.752640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789480063.752652:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10293:x1876405526753792:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480063.752686:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480063.752715:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd7be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31d9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480063.753048:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789480063.753927:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd7be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d9 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.753949:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:3.0:1789480063.753952:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480063.753959:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd7be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d9 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.754006:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789480063.755912:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10293:x1876405526753792:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3105us (3615us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789480063.755929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1789480063.768454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.768668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754048 00000100:00100000:3.0:1789480063.768682:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754048 00000100:00100000:3.0:1789480063.768759:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1789480063.768771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10293:x1876405526754048:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480063.769057:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+15:10293:x1876405526754048:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 288us (615us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789480063.769065:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480063.867690:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.868125:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754176 00000100:00100000:3.0:1789480063.868142:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754176 00000100:00100000:3.0:1789480063.868229:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1789480063.868242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+15:10299:x1876405526754176:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480063.868268:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480063.868324:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd7cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31e0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868393:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868407:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868420:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480063.868487:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789480063.868491:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480063.868510:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868537:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd7cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e0 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868559:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e0 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480063.868567:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480063.868570:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480063.868574:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:3.0:1789480063.868665:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:10299:x1876405526754176:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 425us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480063.868673:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1789480063.876363:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480063.876522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754432 00000100:00100000:0.0:1789480063.876541:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754432 00000100:00100000:0.0:1789480063.876662:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1789480063.876676:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+16:10299:x1876405526754432:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480063.876864:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480063.876893:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd7da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.896424:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd7e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.896452:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.896467:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480063.896504:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789480063.898404:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd7da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e7 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.898435:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e7 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.898444:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:0.0:1789480063.898447:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480063.898464:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:0.0:1789480063.898639:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10299:x1876405526754432:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 21964us (22286us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789480063.898648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1789480063.906982:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480063.907109:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480063.907739:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754816 00000100:00100000:2.0:1789480063.907758:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754816 00000100:00100000:2.0:1789480063.907856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1789480063.907869:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:2348:x1876405526754816:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480063.907891:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789480063.907901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754688 00000100:00100000:0.0:1789480063.907913:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754688 00010000:00010000:2.0:1789480063.907940:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd7e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e7 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.907979:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:2.0:1789480063.907990:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480063.908063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480063.908075:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10299:x1876405526754688:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480063.908102:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480063.908124:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fd7ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31ee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.908230:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.908245:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.908270:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480063.908307:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789480063.908449:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fd7ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31ee expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480063.908523:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+20:2348:x1876405526754816:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 647us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.908818:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00010000:00010000:1.0:1789480063.909375:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31ee expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.909391:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:1.0:1789480063.909394:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480063.909398:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2800, rc 0) 00000100:00100000:1.0:1789480063.909462:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+19:10299:x1876405526754688:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1387us (2491us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789480063.909809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480063.922749:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480063.922912:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526754944 00000100:00100000:0.0:1789480063.922922:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526754944 00000100:00100000:0.0:1789480063.922983:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789480063.922994:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526754944:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1789480063.923054:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.923076:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.923085:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480063.923090:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480063.923094:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.923133:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.923150:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 7 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480063.923165:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876405551958400:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480063.923501:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6dbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480063.928372:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480063.928487:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755072 00000100:00100000:1.0:1789480063.928496:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755072 00002000:00100000:1.0:1789480063.928547:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d22ba439c00 x1876405526755072/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:214/0 lens 504/0 e 0 to 0 dl 1789480074 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480063.928558:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22ba439c00 with x1876405526755072 ext(0->12) 00010000:00010000:1.0:1789480063.928568:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 8 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.928587:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 8 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480063.928608:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22ba439c00 00000100:00100000:1.0:1789480063.928648:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480063.928659:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526755072:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:0.0:1789480063.929146:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876405551958400:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480063.929175:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789480063.985633:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000100:00100000:2.0:1789480063.991311:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526755072:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 62625us (62922us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789480063.991334:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:2.0:1789480063.991348:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d22ba439c00 x1876405526755072/t4294967299(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:214/0 lens 504/448 e 0 to 0 dl 1789480074 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480063.991359:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22ba439c00 with x1876405526755072 ext(0->12) 00010000:00010000:2.0:1789480063.991369:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480063.991392:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480063.991400:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22ba439c00 00000100:00100000:2.0:1789480063.997501:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480063.997584:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755200 00000100:00100000:0.0:1789480063.997594:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755200 00010000:00010000:0.0:1789480063.997640:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480063.997685:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789480063.997695:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526755200:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480063.997712:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789480063.997732:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789480063.997736:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789480063 00002000:00010000:0.0:1789480063.997748:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789480064 00002000:00010000:0.0:1789480063.997751:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789480063 00010000:00010000:0.0:1789480063.997757:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.997772:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.997794:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e5c151/0xbb972366037fd7b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31d2 expref: 9 pid: 8279 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.997998:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480063.998004:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480063.998010:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.998020:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480063.998073:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480063.998132:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526755200:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 438us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.998140:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00010000:00010000:1.0:1789480063.998193:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998203:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998229:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998237:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998245:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998253:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480063.998258:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998267:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998327:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480063.998334:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fd804 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480063.998381:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526754944:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 75389us (75654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480063.998388:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789480064.000693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480064.000749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755456 00000100:00100000:3.0:1789480064.000760:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755456 00000100:00080000:1.0:1789480064.000814:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480064.000836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789480064.000846:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+19:10299:x1876405526755456:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:3.0:1789480064.000909:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31ee expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480064.001255:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789480064.001343:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789480064.001868:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789480064.001929:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.001945:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.001954:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.001991:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.002008:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 23 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480064.002035:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876405551958528:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480064.002134:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789480064.004869:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876405551958528:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480064.004904:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480064.007004:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480064.007089:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755584 00000100:00100000:2.0:1789480064.007099:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755584 00010000:00010000:2.0:1789480064.007141:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 24 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480064.007182:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789480064.007208:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:2347:x1876405526755584:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480064.007225:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480064.007232:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 24 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007248:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 24 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007273:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fd79b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31c4 expref: 24 pid: 5831 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007318:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:2.0:1789480064.007324:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007334:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007341:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.007375:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480064.007435:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+23:2347:x1876405526755584:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480064.007442:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:3.0:1789480064.007894:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.007903:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480064.008039:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789480064.008260:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789480064.008415:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551958656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789480064.008516:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480064.008552:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c2fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480064.008577:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551958656 00000100:00100000:1.0:1789480064.008584:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551958656 00000100:00100000:1.0:1789480064.008642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480064.008650:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551958656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789480064.008727:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551958656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480064.008734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480064.008779:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551958656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789480064.009511:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789480064.009575:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551958784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789480064.009621:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480064.009647:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3a80 going to sleep for 11 seconds 00000100:00080000:3.0:1789480064.009714:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480064.009859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551958784 00000100:00100000:1.0:1789480064.009866:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551958784 00000100:00100000:1.0:1789480064.009907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480064.009915:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551958784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789480064.010128:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876405551958784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 214us (506us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789480064.010143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480064.010485:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551958784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789480064.010538:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789480064.010577:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010587:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010594:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010601:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480064.010619:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010626:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010642:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:2.0:1789480064.010646:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789480064.010651:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.010657:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fd80b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480064.010835:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789480064.011076:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789480064.011088:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357007805068ns, next at 358007803158ns, rc = 0 00000001:00080000:2.0:1789480064.011101:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789480064.011134:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2290ce3b00) 00010000:00010000:2.0:1789480064.011138:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480064.011145:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd7f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31ee expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480064.011244:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:10299:x1876405526755456:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 10399us (10561us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789480064.011253:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000020:00080000:2.0:1789480064.011256:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789480064.017347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480064.017463:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755712 00000100:00100000:3.0:1789480064.017484:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755712 00000100:00100000:3.0:1789480064.017559:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1789480064.017571:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+26:10299:x1876405526755712:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480064.017605:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480064.017634:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31f5 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.017711:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31f5 expref: 27 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.017725:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31f5 expref: 27 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.017758:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480064.017762:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480064.017766:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789480064.017844:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+27:10299:x1876405526755712:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 274us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480064.017851:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1789480064.025419:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.025725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526755968 00000100:00100000:0.0:1789480064.025737:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526755968 00000100:00100000:0.0:1789480064.025807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789480064.025819:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eacc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+27:10299:x1876405526755968:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480064.026106:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eacc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+28:10299:x1876405526755968:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 288us (697us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789480064.026115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00010000:00010000:2.0:1789480064.090831:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480064.144614:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480064.145137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526756224 00000100:00100000:3.0:1789480064.145149:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526756224 00000100:00100000:3.0:1789480064.145216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789480064.145245:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:10309:x1876405526756224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480064.145272:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480064.145347:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f31fc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480064.145444:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789480064.145579:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd819 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31fc expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.145595:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:3.0:1789480064.145598:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480064.145735:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31fc expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.145752:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480064.145896:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+29:10309:x1876405526756224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 653us (1293us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789480064.145904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1789480064.165193:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480064.165462:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526756352 00000100:00100000:3.0:1789480064.165481:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526756352 00000100:00100000:2.0:1789480064.165699:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1789480064.165712:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+29:10309:x1876405526756352:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789480064.165809:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165834:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165846:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165862:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165869:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165875:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165982:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165991:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.165998:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480064.166050:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166072:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166079:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166087:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166094:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480064.166098:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166106:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166117:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480064.166120:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480064.166125:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166139:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fd827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166153:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166159:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166166:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166171:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480064.166174:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166181:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166189:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d228804df00) 00010000:00010000:2.0:1789480064.166191:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480064.166194:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166201:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fd82e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166226:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166232:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166246:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166251:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480064.166254:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166261:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166269:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:2.0:1789480064.166331:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480064.166335:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480064.166342:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fd835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480064.166426:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+29:10309:x1876405526756352:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 717us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480064.166435:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789480064.174214:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480064.174448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526756608 00000100:00100000:3.0:1789480064.174459:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526756608 00000100:00100000:3.0:1789480064.174521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1789480064.174532:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+29:10309:x1876405526756608:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480064.176952:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10309:x1876405526756608:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 2409us (2738us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789480064.176967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789480064.261832:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480064.261938:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526756864 00000100:00100000:1.0:1789480064.261948:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526756864 00000100:00100000:1.0:1789480064.262098:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1789480064.262109:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10312:x1876405526756864:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480064.262134:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480064.262156:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fd83c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3203 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262235:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262254:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262266:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262321:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262329:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262336:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262507:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262518:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.262526:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480064.262978:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789480064.263164:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263172:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263179:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263185:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480064.263189:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263197:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263210:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480064.263214:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480064.263219:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263236:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fd843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263249:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263255:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263260:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263264:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480064.263267:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263272:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263279:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedf900) 00010000:00010000:1.0:1789480064.263325:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480064.263329:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263334:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fd84a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263379:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fd83c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 33 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263406:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 32 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.263413:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:1.0:1789480064.263415:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480064.263418:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146a00, rc 0) 00000100:00100000:1.0:1789480064.264233:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+32:10312:x1876405526756864:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2121us (2407us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789480064.264243:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1789480064.272162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.272332:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526756992 00000100:00100000:0.0:1789480064.272343:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526756992 00000100:00100000:0.0:1789480064.272417:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480064.272427:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:10312:x1876405526756992:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789480064.272508:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272525:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272536:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272562:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272570:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272577:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272583:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480064.272588:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272595:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272604:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480064.272607:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480064.272611:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.272616:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd85f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480064.272706:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:10312:x1876405526756992:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 279us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480064.272713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789480064.281059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.281223:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526757248 00000100:00100000:0.0:1789480064.281235:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526757248 00000100:00100000:0.0:1789480064.281324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480064.281336:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:10312:x1876405526757248:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480064.281581:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+33:10312:x1876405526757248:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 246us (530us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789480064.281589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480064.347250:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551958912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480064.347360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480064.347422:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551958912 00000100:00100000:3.0:1789480064.347431:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551958912 00000100:00100000:3.0:1789480064.347495:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789480064.347506:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551958912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480064.347527:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480064.347584:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551958912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480064.347591:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789480064.347740:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551958912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480064.715906:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480064.716031:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526757504 00000100:00100000:1.0:1789480064.716042:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526757504 00000100:00100000:1.0:1789480064.716113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789480064.716124:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+33:10343:x1876405526757504:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789480064.716148:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480064.716172:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd866 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f320a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.716313:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd86d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.716327:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.716339:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480064.716350:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789480064.716516:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f320a expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.716534:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f320a expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.716542:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:1.0:1789480064.716545:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480064.716549:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147600, rc 0) 00000100:00100000:1.0:1789480064.716625:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10343:x1876405526757504:12345-192.168.204.54@tcp:101:cat.0 Request processed in 503us (729us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789480064.716632:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480064.722927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480064.722980:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.723067:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526757888 00000100:00100000:0.0:1789480064.723089:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526757888 00000100:00100000:0.0:1789480064.723158:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1789480064.723169:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+35:2347:x1876405526757888:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480064.723185:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480064.723216:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd86d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f320a expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.723235:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480064.723239:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480064.723337:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+34:2347:x1876405526757888:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 170us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480064.723344:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789480064.723723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526757760 00000100:00100000:3.0:1789480064.723728:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526757760 00000100:00100000:3.0:1789480064.723766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1789480064.723773:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:10343:x1876405526757760:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:3.0:1789480064.724062:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10343:x1876405526757760:12345-192.168.204.54@tcp:35:cat.0 Request processed in 288us (1146us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789480064.724069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480064.806400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.806515:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526758144 00000100:00100000:0.0:1789480064.806526:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526758144 00000100:00100000:0.0:1789480064.806590:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1789480064.806610:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10349:x1876405526758144:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1789480064.806635:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480064.806638:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789480064.806665:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fd7d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31e0 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806684:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480064.806690:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480064.806702:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd87b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3211 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806803:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806820:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 35 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806829:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806863:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 35 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.806880:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 35 pid: 11710 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480064.806919:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551959040:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480064.807022:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291d840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480064.812459:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551959040:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480064.812492:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480064.813216:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480064.813306:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526758272 00000100:00100000:0.0:1789480064.813313:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526758272 00010000:00010000:0.0:1789480064.813348:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 36 pid: 11710 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480064.813384:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1789480064.813393:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+36:2348:x1876405526758272:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480064.813405:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480064.813411:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 36 pid: 11710 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813423:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 36 pid: 11710 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813444:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3203 expref: 36 pid: 11710 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813457:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480064.813462:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813476:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813483:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480064.813510:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480064.813554:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+35:2348:x1876405526758272:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480064.813561:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:3.0:1789480064.813619:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.813626:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480064.813648:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789480064.813832:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fd87b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.813847:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.813866:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480064.813869:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480064.813871:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:3.0:1789480064.813898:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10349:x1876405526758144:12345-192.168.204.54@tcp:101:dd.0 Request processed in 7291us (7511us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789480064.813905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1789480064.817876:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480064.818190:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526758528 00000100:00100000:1.0:1789480064.818201:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526758528 00000100:00100000:1.0:1789480064.818417:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1789480064.818431:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10349:x1876405526758528:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:1.0:1789480064.818747:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.818764:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480064.818775:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480064.818827:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789480064.818851:0:11710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bf9a5e7 reply state 0000000093bd39dc transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480064.818860:0:11710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480064.818958:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+38:10349:x1876405526758528:12345-192.168.204.54@tcp:36:dd.0 Request processed in 531us (1091us total) trans 4294967335 rc 0/0 00010000:00010000:3.0:1789480064.825530:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825551:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825559:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825566:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480064.825571:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825580:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825609:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480064.825613:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480064.825618:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480064.825625:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480064.825773:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000020:00080000:1.0:1789480064.825783:0:11710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789480064.858719:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480064.867794:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551959168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480064.867888:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480064.875937:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551959168 00000100:00100000:3.0:1789480064.875961:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551959168 00000100:00080000:3.0:1789480064.876511:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480064.876587:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789480064.876603:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551959168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480064.876648:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480064.876761:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551959168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (8873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480064.876768:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480064.877218:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551959168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480065.114750:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480065.410386:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480065.415328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526758656 00000100:00100000:3.0:1789480065.415345:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526758656 00000100:00100000:3.0:1789480065.415444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789480065.415456:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+37:10363:x1876405526758656:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:3.0:1789480065.415481:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480065.415506:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3218 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415573:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415601:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415613:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415628:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415635:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415643:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415750:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415762:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.415770:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.416258:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.416276:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 38 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480065.416312:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551959296:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480065.416481:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c2f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480065.420951:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551959296:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480065.420988:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480065.421435:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480065.421685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526758912 00000100:00100000:3.0:1789480065.421692:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526758912 00000100:00100000:3.0:1789480065.421747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789480065.421756:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+39:5589:x1876405526758912:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789480065.422355:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+40:5589:x1876405526758912:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 598us (920us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789480065.422376:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789480065.429077:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480065.429489:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526759040 00000100:00100000:2.0:1789480065.429501:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526759040 00010000:00010000:2.0:1789480065.429550:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 40 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480065.429584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1789480065.429597:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+40:2348:x1876405526759040:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480065.429613:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480065.429620:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 40 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429637:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 40 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429801:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fd882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3211 expref: 40 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429819:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480065.429824:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429834:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429842:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480065.429937:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480065.430009:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+39:2348:x1876405526759040:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 415us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480065.430017:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:3.0:1789480065.431161:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431172:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480065.431482:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789480065.431488:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480065.431542:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431557:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431566:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431573:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431579:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431655:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480065.431660:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431669:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431825:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480065.431841:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480065.431847:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431854:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431869:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431874:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431880:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431886:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480065.431889:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431895:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431902:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22b7076600) 00010000:00010000:3.0:1789480065.431904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480065.431907:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.431913:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd8a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.432121:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3218 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.432150:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3218 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.432158:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480065.432160:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480065.432163:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480065.432590:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+38:10363:x1876405526758656:12345-192.168.204.54@tcp:101:stat.0 Request processed in 17125us (22205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480065.432598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480065.575022:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480065.575269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526759296 00000100:00100000:3.0:1789480065.575333:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526759296 00000100:00100000:3.0:1789480065.575416:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789480065.575431:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+38:10369:x1876405526759296:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:3.0:1789480065.575544:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480065.575594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3218 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.575622:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480065.575627:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480065.575940:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.575959:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.575971:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480065.576054:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789480065.576083:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0196233 reply state 00000000e872d759 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480065.576093:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480065.577337:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+40:10369:x1876405526759296:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1899us (2321us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789480065.577351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000020:00080000:3.0:1789480065.577360:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480065.584090:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584116:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584125:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584142:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480065.584149:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584158:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584181:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480065.584184:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480065.584190:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.584196:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480065.777858:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480065.783823:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526759424 00000100:00100000:1.0:1789480065.783847:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526759424 00000100:00100000:1.0:1789480065.783964:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1789480065.783978:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+39:10383:x1876405526759424:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1789480065.784024:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480065.784052:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f321f expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784152:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784170:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784184:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784373:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784383:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784391:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784510:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784537:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784545:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480065.784597:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789480065.784603:0:11710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480065.784632:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784645:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784655:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784663:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784671:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784679:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480065.784684:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784692:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784706:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480065.784715:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480065.784722:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784728:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd8c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784745:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784751:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784758:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784763:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480065.784766:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784772:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784779:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedf900) 00010000:00010000:1.0:1789480065.784782:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480065.784784:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784790:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784829:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 41 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784855:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 40 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480065.784863:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:1.0:1789480065.784866:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480065.784869:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146a00, rc 0) 00000100:00100000:1.0:1789480065.784978:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+40:10383:x1876405526759424:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1002us (7135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480065.784987:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789480065.939077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480065.940120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526759680 00000100:00100000:3.0:1789480065.940147:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526759680 00000100:00100000:3.0:1789480065.940237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1789480065.940249:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+40:10393:x1876405526759680:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480065.940276:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480065.940337:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3226 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480065.940462:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789480065.941274:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3226 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.941334:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:3.0:1789480065.941338:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480065.941346:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3226 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480065.941365:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480065.941513:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+41:10393:x1876405526759680:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1265us (2450us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789480065.941523:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1789480065.957779:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480065.958079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526759936 00000100:00100000:0.0:1789480065.958100:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526759936 00000100:00100000:0.0:1789480065.958252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480065.958275:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+41:10393:x1876405526759936:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480065.958766:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+42:10393:x1876405526759936:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 498us (1000us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789480065.958774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480066.067037:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480066.067392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526760192 00000100:00100000:3.0:1789480066.067411:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526760192 00000100:00100000:3.0:1789480066.067574:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1789480066.067592:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+42:10399:x1876405526760192:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480066.067649:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480066.067679:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f322d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789480066.067899:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480066.068120:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.068572:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 43 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.068588:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.068815:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 43 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.068840:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 43 pid: 11710 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480066.068858:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551959424:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480066.069042:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3540 going to sleep for 11 seconds 00000040:00080000:3.0:1789480066.077512:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480066.078086:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551959424:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480066.078127:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480066.079468:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480066.085042:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526760320 00000100:00100000:1.0:1789480066.085071:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526760320 00010000:00010000:1.0:1789480066.085174:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 44 pid: 11710 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480066.085256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1789480066.085271:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+44:2347:x1876405526760320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480066.085314:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480066.085323:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 44 pid: 11710 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085345:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 44 pid: 11710 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085396:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fd8cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f321f expref: 44 pid: 11710 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085448:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:1.0:1789480066.085456:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085468:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085477:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.085525:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480066.085643:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.085655:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480066.085691:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1789480066.085806:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+44:2347:x1876405526760320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 537us (6347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480066.085816:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:2.0:1789480066.085922:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fd8e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.085953:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.085976:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:2.0:1789480066.085980:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480066.085990:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:2.0:1789480066.086023:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+43:10399:x1876405526760192:12345-192.168.204.54@tcp:101:bash.0 Request processed in 18439us (19009us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789480066.086030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1789480066.092075:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.092254:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526760576 00000100:00100000:2.0:1789480066.092266:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526760576 00000100:00100000:2.0:1789480066.092352:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1789480066.092362:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+43:10399:x1876405526760576:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1789480066.092661:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.092681:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.092693:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480066.092751:0:8260:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789480066.092780:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a5ac54f reply state 00000000818fddb4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480066.092790:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480066.092921:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+46:10399:x1876405526760576:12345-192.168.204.54@tcp:36:bash.0 Request processed in 560us (857us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789480066.092929:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000020:00080000:2.0:1789480066.092935:0:8260:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480066.102157:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102178:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102186:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102192:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480066.102197:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102205:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102266:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480066.102269:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480066.102278:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.102306:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd8f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480066.103659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.103767:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526760704 00000100:00100000:0.0:1789480066.103778:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526760704 00000100:00100000:0.0:1789480066.103846:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1789480066.103856:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+45:10399:x1876405526760704:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480066.103881:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480066.103900:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd900 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3234 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.104012:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.104027:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.104035:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.104070:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.104086:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 46 pid: 5830 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480066.104100:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551959552:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480066.104201:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291d840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480066.111008:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551959552:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480066.111047:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480066.111712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.112171:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526760832 00000100:00100000:0.0:1789480066.112180:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526760832 00010000:00010000:0.0:1789480066.112232:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 47 pid: 5830 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480066.112274:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1789480066.112307:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+47:2348:x1876405526760832:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480066.112323:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480066.112330:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 47 pid: 5830 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112345:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 47 pid: 5830 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112367:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fd8eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f322d expref: 47 pid: 5830 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112385:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480066.112391:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112401:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112425:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.112452:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480066.112518:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+46:2348:x1876405526760832:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 235us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.112526:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00010000:00010000:3.0:1789480066.113881:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.113896:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480066.113947:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789480066.113952:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480066.113976:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.114023:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fd900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3234 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.114041:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3234 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.114058:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480066.114061:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480066.114064:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6800, rc 0) 00000100:00100000:3.0:1789480066.114126:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+45:10399:x1876405526760704:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10272us (10476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.114145:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1789480066.128997:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.129264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526761088 00000100:00100000:0.0:1789480066.129276:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526761088 00000100:00100000:0.0:1789480066.129449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480066.129460:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+45:10399:x1876405526761088:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1789480066.129776:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+46:10399:x1876405526761088:12345-192.168.204.54@tcp:35:bash.0 Request processed in 318us (799us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789480066.129784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1789480066.141526:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480066.306232:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.306510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526761344 00000100:00100000:0.0:1789480066.306522:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526761344 00000100:00100000:0.0:1789480066.306597:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1789480066.306608:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+46:10409:x1876405526761344:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480066.306635:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480066.306657:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd90e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f323b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480066.306752:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789480066.306883:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd90e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f323b expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.306917:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:0.0:1789480066.306920:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480066.306926:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd90e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f323b expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.306941:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7400, rc 0) 00000100:00100000:0.0:1789480066.307021:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10409:x1876405526761344:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 415us (801us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789480066.307028:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1789480066.316365:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.316482:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526761472 00000100:00100000:2.0:1789480066.316496:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526761472 00000100:00100000:2.0:1789480066.316561:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1789480066.316573:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10409:x1876405526761472:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789480066.316658:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316674:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316686:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316702:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316710:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316717:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316812:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316822:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316848:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480066.316893:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316907:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316913:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316920:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316927:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480066.316932:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316941:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316953:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480066.316956:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480066.316961:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316966:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd91c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.316991:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317003:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317009:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317014:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480066.317017:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317023:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317031:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d228804df00) 00010000:00010000:2.0:1789480066.317033:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480066.317036:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317041:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317056:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317075:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317205:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317211:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480066.317220:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317227:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317241:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:2.0:1789480066.317244:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480066.317247:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.317253:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fd92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480066.317488:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10409:x1876405526761472:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 916us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480066.317497:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789480066.329551:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.329805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526761728 00000100:00100000:2.0:1789480066.329816:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526761728 00000100:00100000:2.0:1789480066.329881:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480066.329892:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10409:x1876405526761728:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480066.330242:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10409:x1876405526761728:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 350us (699us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789480066.330250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480066.428091:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.428520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526761984 00000100:00100000:0.0:1789480066.428531:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526761984 00000100:00100000:0.0:1789480066.428712:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1789480066.428724:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10412:x1876405526761984:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480066.428749:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480066.428870:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3242 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429026:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429040:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429052:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429066:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429090:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429098:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429215:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429224:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429232:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480066.429241:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789480066.429361:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429370:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429376:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429382:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480066.429386:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429394:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429415:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480066.429418:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480066.429423:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429430:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd938 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429443:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429450:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429455:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429460:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480066.429462:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429468:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429475:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2290ce3300) 00010000:00010000:0.0:1789480066.429477:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480066.429479:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429484:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd93f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429538:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3242 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.429552:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3242 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.430161:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480066.430164:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480066.430168:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6600, rc 0) 00000100:00100000:0.0:1789480066.430251:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10412:x1876405526761984:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1528us (2171us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789480066.430259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789480066.436652:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480066.436703:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480066.436803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526762240 00000100:00100000:3.0:1789480066.436814:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526762240 00000100:00100000:3.0:1789480066.436872:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1789480066.436883:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10412:x1876405526762240:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789480066.436970:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.436999:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437012:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437041:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437049:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437056:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437062:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480066.437066:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437073:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437099:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:3.0:1789480066.437102:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480066.437108:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480066.437114:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480066.437199:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10412:x1876405526762240:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 318us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.437207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1789480066.437917:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526762112 00000100:00100000:0.0:1789480066.437923:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526762112 00000100:00100000:0.0:1789480066.437995:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1789480066.438005:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+50:2348:x1876405526762112:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480066.438019:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480066.438037:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3242 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.438051:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480066.438056:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480066.438102:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+49:2348:x1876405526762112:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 100us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.438109:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789480066.442067:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.442244:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526762496 00000100:00100000:2.0:1789480066.442255:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526762496 00000100:00100000:2.0:1789480066.442340:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789480066.442352:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+49:10412:x1876405526762496:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480066.442621:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10412:x1876405526762496:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 271us (565us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789480066.442637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789480066.683446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.683564:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526762752 00000100:00100000:2.0:1789480066.683576:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526762752 00000100:00100000:2.0:1789480066.684130:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1789480066.684143:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10430:x1876405526762752:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1789480066.684171:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480066.684196:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd95b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3249 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.684339:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd962 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.684447:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.684463:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480066.684475:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789480066.684629:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fd95b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3249 expref: 53 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.684649:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3249 expref: 52 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480066.684657:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:2.0:1789480066.684660:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789480066.684665:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789480066.684892:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10430:x1876405526762752:12345-192.168.204.54@tcp:101:cat.0 Request processed in 750us (1456us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789480066.684911:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1789480066.728694:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.728919:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526762880 00000100:00100000:0.0:1789480066.728937:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526762880 00000100:00100000:0.0:1789480066.729015:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1789480066.729025:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10431:x1876405526762880:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480066.729212:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480066.729236:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3250 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729400:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729416:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729428:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480066.729461:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789480066.729465:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480066.729482:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729510:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3250 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729530:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3250 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.729540:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480066.729543:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480066.729561:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7400, rc 0) 00000100:00100000:0.0:1789480066.729629:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10431:x1876405526762880:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 604us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.729636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1789480066.738860:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480066.739171:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763264 00000100:00100000:2.0:1789480066.739182:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763264 00000100:00100000:2.0:1789480066.739243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789480066.739253:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10431:x1876405526763264:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480066.739625:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10431:x1876405526763264:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 371us (774us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789480066.739633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789480066.746207:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.746326:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763392 00000100:00100000:0.0:1789480066.746337:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763392 00000100:00100000:0.0:1789480066.746425:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1789480066.746436:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10431:x1876405526763392:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:0.0:1789480066.746452:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789480066.746481:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3234 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.746507:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fd962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3249 expref: 53 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.746521:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fd812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31f5 expref: 52 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.746533:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076300) 00010000:00010000:0.0:1789480066.746549:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480066.746606:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10431:x1876405526763392:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 172us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.746615:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789480066.749040:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480066.749159:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763520 00000100:00100000:1.0:1789480066.749172:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763520 00000100:00100000:1.0:1789480066.749247:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1789480066.749258:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10431:x1876405526763520:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:1.0:1789480066.749456:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.749485:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480066.749502:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480066.749911:0:11710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480066.750160:0:11710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789480066.750246:0:11710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789480066.750760:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10431:x1876405526763520:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1498us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480066.750772:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1789480066.803492:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480066.804133:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763648 00000100:00100000:0.0:1789480066.804148:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763648 00000100:00100000:0.0:1789480066.805219:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1789480066.805238:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10433:x1876405526763648:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480066.805302:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480066.805332:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd985 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3257 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805423:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805443:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805458:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805473:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805480:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805485:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805622:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805631:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805638:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480066.805688:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789480066.805701:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480066.805732:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805748:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805775:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805782:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805790:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805797:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480066.805802:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805811:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805826:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480066.805830:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480066.805836:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805843:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd98c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805860:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805881:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805888:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805893:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480066.805897:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805903:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805911:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2290ce3300) 00010000:00010000:0.0:1789480066.805914:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480066.805917:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805923:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.805988:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fd985 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.806003:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480066.806011:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:0.0:1789480066.806014:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480066.806023:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7200, rc 0) 00000100:00100000:0.0:1789480066.806491:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10433:x1876405526763648:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1257us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.806501:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1789480066.906689:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551959936:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.906808:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480066.906892:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789480066.906899:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551959808:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.906924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480066.906942:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551960320:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.906984:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480066.907129:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551960064:0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480066.907192:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789480066.907197:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551959680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907230:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480066.907258:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551960192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907308:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480066.907348:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551959680 00000100:00100000:3.0:1789480066.907358:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551959680 00000100:00100000:3.0:1789480066.907412:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789480066.907422:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551959680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907508:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3300:x1876405551959680:12345-0@lo:400:kworker.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.907517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789480066.907588:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551959680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907619:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551960320 00000100:00100000:3.0:1789480066.907623:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551960320 00000100:00100000:3.0:1789480066.907670:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551960064 00000100:00100000:3.0:1789480066.907673:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551960064 00000100:00100000:3.0:1789480066.907698:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789480066.907707:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551960320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907746:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551960320:12345-0@lo:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.907768:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789480066.907783:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789480066.907789:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551960064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907823:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551960064:12345-0@lo:400:kworker.0 Request processed in 35us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.907829:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789480066.907853:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480066.907857:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480066.907879:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551960064:0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.907899:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551959936 00000100:00100000:3.0:1789480066.907903:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551959936 00000100:00100000:3.0:1789480066.907935:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551959808 00000100:00100000:3.0:1789480066.907938:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551959808 00000100:00100000:3.0:1789480066.907956:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551960192 00000100:00100000:3.0:1789480066.907958:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551960192 00000100:00100000:3.0:1789480066.908004:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789480066.908415:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551959936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.908463:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551959936:12345-0@lo:400:kworker.0 Request processed in 453us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.908469:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789480066.908488:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789480066.908495:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551959808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.908524:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551959808:12345-0@lo:400:kworker.0 Request processed in 29us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.908530:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789480066.908542:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789480066.908548:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551960192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480066.908583:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876405551960192:12345-0@lo:400:kworker.0 Request processed in 35us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480066.908590:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789480066.908608:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480066.908632:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876405551960192:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.908902:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551959808:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.908916:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551960320:0@lo:400:kworker.0 00000100:00100000:0.0:1789480066.908927:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551959936:0@lo:400:kworker.0 00000040:00080000:2.0:1789480067.098518:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480067.098527:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480067.098579:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789480067.098585:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480067.098752:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551960448:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480067.098857:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db300 going to sleep for 11 seconds 00000100:00100000:1.0:1789480067.109886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.109933:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763776 00000100:00100000:1.0:1789480067.109942:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763776 00000100:00100000:1.0:1789480067.110009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789480067.110022:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526763776:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789480067.110119:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526763776:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 101us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480067.110127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789480067.110337:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551960448:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480067.122747:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.122791:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526763904 00000100:00100000:2.0:1789480067.122803:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526763904 00000100:00100000:2.0:1789480067.122863:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789480067.122874:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10444:x1876405526763904:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480067.122909:0:8260:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480067.123048:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10444:x1876405526763904:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 176us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.123056:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789480067.139037:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.139159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526764032 00000100:00100000:3.0:1789480067.139169:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526764032 00000100:00100000:3.0:1789480067.139231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1789480067.139241:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10444:x1876405526764032:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789480067.139373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139393:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139432:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139450:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139462:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139494:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139503:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139510:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480067.139554:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789480067.139558:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480067.139574:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139586:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139592:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139608:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139620:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480067.139625:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139633:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139646:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:3.0:1789480067.139649:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480067.139655:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139662:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fd9a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139676:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139682:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139688:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139694:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480067.139697:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139711:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139719:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d22b7076600) 00010000:00010000:3.0:1789480067.139733:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480067.139737:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139744:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fd9a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139761:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139768:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139774:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139780:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480067.139783:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139790:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139797:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:3.0:1789480067.139800:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480067.139803:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.139818:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fd9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480067.139895:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10444:x1876405526764032:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 656us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.139904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1789480067.149610:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.149702:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526764288 00000100:00100000:2.0:1789480067.149712:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526764288 00000100:00100000:2.0:1789480067.149774:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1789480067.149785:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10444:x1876405526764288:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480067.149807:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480067.149829:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd9b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f325e expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.149937:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.149955:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.149979:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480067.149990:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789480067.150094:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150103:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150111:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150117:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.150121:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150145:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150159:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:2.0:1789480067.150162:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480067.150167:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150173:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fd9bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150213:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd9b6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f325e expref: 54 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150223:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:2.0:1789480067.150225:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480067.150228:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fd9b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f325e expref: 54 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.150238:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480067.150334:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526764288:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 550us (734us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789480067.150341:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1789480067.163057:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.163144:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526764416 00000100:00100000:3.0:1789480067.163157:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526764416 00000100:00100000:3.0:1789480067.163220:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1789480067.163231:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526764416:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480067.163272:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480067.163428:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526764416:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.163436:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00010000:00010000:1.0:1789480067.168813:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480067.173724:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.178569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526764672 00000100:00100000:1.0:1789480067.178585:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526764672 00000100:00100000:0.0:1789480067.179804:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789480067.179817:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526764672:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480067.179838:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480067.179841:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789480067.179869:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3250 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.179900:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480067.179906:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480067.179920:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd9cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3265 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789480067.180357:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789480067.180571:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.180585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.180596:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.180710:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd9cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3265 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.180725:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3265 expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.180732:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3300) 00010000:00010000:0.0:1789480067.180735:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480067.180738:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6a00, rc 0) 00000100:00100000:0.0:1789480067.180808:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10444:x1876405526764672:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 994us (7265us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789480067.180815:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789480067.193518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.193647:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526764928 00000100:00100000:1.0:1789480067.193657:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526764928 00000100:00100000:1.0:1789480067.193706:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1789480067.193717:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10444:x1876405526764928:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789480067.193794:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480067.193823:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fd9d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3265 expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193840:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3300) 00010000:00010000:1.0:1789480067.193852:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480067.193874:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193888:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193898:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193959:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193980:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.193988:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194066:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194075:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194081:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194093:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480067.194097:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194105:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194115:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480067.194117:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480067.194121:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194127:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fd9e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194139:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194145:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194151:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194155:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480067.194157:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194163:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194179:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa49da294 (ffff8d22abedf200) 00010000:00010000:1.0:1789480067.194181:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480067.194184:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.194190:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fd9e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa49da294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.194522:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526764928:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 564us (773us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480067.194532:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1789480067.206083:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480067.206137:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765056 00000100:00100000:0.0:1789480067.206147:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765056 00000100:00100000:0.0:1789480067.206204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1789480067.206213:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10444:x1876405526765056:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480067.206232:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480067.206255:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd9ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f326c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206317:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206330:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206341:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206444:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fd9ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206460:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.206468:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480067.206471:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480067.206474:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7400, rc 0) 00000100:00100000:0.0:1789480067.206531:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10444:x1876405526765056:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 319us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480067.206562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1789480067.214127:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.214214:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765312 00000100:00100000:1.0:1789480067.214226:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765312 00000100:00100000:1.0:1789480067.214318:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1789480067.214328:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10444:x1876405526765312:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789480067.214446:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.214465:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.214479:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480067.214805:0:11710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789480067.214818:0:11710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360211534789ns, next at 361211531334ns, rc = 0 00000004:00010000:1.0:1789480067.214914:0:11710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e031e97c reply state 00000000b3ddecf7 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.214936:0:11710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480067.215056:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10444:x1876405526765312:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 728us (944us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789480067.215064:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00010000:00010000:3.0:1789480067.222656:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222675:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222684:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222691:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480067.222697:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222706:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222739:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480067.222742:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480067.222747:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.222754:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fd9fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480067.222947:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.223116:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765440 00000100:00100000:3.0:1789480067.223127:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765440 00000100:00100000:3.0:1789480067.223185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1789480067.223195:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10444:x1876405526765440:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480067.223224:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480067.223241:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.223431:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.223447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.223468:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480067.223471:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480067.223475:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5400, rc 0) 00000100:00100000:3.0:1789480067.223585:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10444:x1876405526765440:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 390us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.223605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:1.0:1789480067.245161:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.245999:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765568 00000100:00100000:3.0:1789480067.246016:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765568 00000100:00100000:3.0:1789480067.246102:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480067.246115:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1876405526765568:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789480067.246162:0:8279:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:3.0:1789480067.246208:0:8279:0:(genops.c:1384:class_connect()) connect: client f712dbb2-3172-402a-b822-94513dd5b6e3, cookie 0xbb972366037fda0a 00002000:00100000:3.0:1789480067.246234:0:8279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f712dbb2-3172-402a-b822-94513dd5b6e3/ffff8d2291255800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789480067.246268:0:8279:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789480067.246805:0:8279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789480067.246851:0:8279:0:(import.c:65:import_set_state_nolock()) ffff8d22babd9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480067.246970:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2344:x1876405526765568:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 Request processed in 846us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.247000:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789480067.250465:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.250572:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765696 00000100:00100000:3.0:1789480067.250585:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765696 00000100:00100000:3.0:1789480067.250724:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480067.250737:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:0:x1876405526765696:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789480067.251401:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480067.431182:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:0:x1876405526765696:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 180439us (180721us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789480067.431195:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000001:00100000:3.0:1789480067.431973:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000001:00080000:3.0:1789480067.431990:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1789480067.449519:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.449943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526765952 00000100:00100000:3.0:1789480067.449966:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526765952 00000100:00100000:3.0:1789480067.450135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480067.450151:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10444:x1876405526765952:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480067.453874:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10444:x1876405526765952:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 3718us (4356us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789480067.453903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480067.456462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.456502:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766208 00000100:00100000:3.0:1789480067.456512:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766208 00000100:00100000:3.0:1789480067.456568:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1789480067.456580:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10444:x1876405526766208:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789480067.456709:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10444:x1876405526766208:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 130us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.456717:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1789480067.466110:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.466144:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766336 00000100:00100000:3.0:1789480067.466155:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766336 00000100:00100000:3.0:1789480067.466213:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1789480067.466223:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10444:x1876405526766336:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480067.466245:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480067.466322:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f327a expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466562:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466585:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466666:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480067.466745:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480067.466771:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466808:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f327a expref: 59 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466830:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f327a expref: 58 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.466840:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480067.466843:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480067.466847:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4e00, rc 0) 00000100:00100000:3.0:1789480067.466911:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10444:x1876405526766336:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 689us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.466919:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1789480067.472196:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.472487:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766464 00000100:00100000:3.0:1789480067.472504:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766464 00000100:00100000:3.0:1789480067.472707:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789480067.472717:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526766464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480067.472734:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480067.472756:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3281 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480067.472784:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c83, blocks: 0x1 00010000:00010000:3.0:1789480067.472803:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1789480067.472813:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480067.472824:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.472845:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.472859:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789480067.472918:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526766464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 202us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.472925:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789480067.485736:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480067.485775:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766720 00000100:00100000:3.0:1789480067.485784:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766720 00000100:00100000:3.0:1789480067.485833:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:3.0:1789480067.485844:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10444:x1876405526766720:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789480067.485947:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10444:x1876405526766720:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480067.485954:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1789480067.508754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.508796:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766848 00000100:00100000:1.0:1789480067.508806:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766848 00000100:00100000:1.0:1789480067.512769:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789480067.512794:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:10444:x1876405526766848:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480067.512819:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480067.512847:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3288 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.512884:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.512894:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480067.512899:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480067.512905:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.512943:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.512974:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 7 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.513691:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876405551960576:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480067.514887:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98d80 going to sleep for 11 seconds 00000001:00080000:1.0:1789480067.529259:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1789480067.529352:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1789480067.529360:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1789480067.529410:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789480067.529440:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2290d51e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789480067.529446:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bb2edf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2290d513c0 00000020:00080000:1.0:1789480067.529450:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bb2ed100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bd5fa800 00000020:00080000:1.0:1789480067.533624:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789480067.533780:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789480067.533807:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551960832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789480067.533911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480067.534006:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551960832 00000100:00100000:1.0:1789480067.534014:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551960832 00000100:00100000:1.0:1789480067.534083:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789480067.534096:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551960832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789480067.534399:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789480067.534405:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789480067.534408:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789480067.534411:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789480067 -> 1789480067 00002000:00010000:1.0:1789480067.534413:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789480067.534473:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551960832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 379us (561us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789480067.534499:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1789480067.534563:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bb2ff480/2, rc 0, transno 4294967302 00000100:00100000:1.0:1789480067.534570:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551960832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789480067.534817:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551960704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789480067.534903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480067.535023:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551960704 00000100:00100000:2.0:1789480067.535032:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551960704 00000100:00100000:2.0:1789480067.535091:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480067.535103:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551960704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789480067.535139:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789480067.535181:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa94c7f, atime: 0x6aa94c80, ctime: 0x6aa94c7f, blocks: 0x1 00010000:00010000:2.0:1789480067.535193:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.535214:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1789480067.535219:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480067.535227:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.535348:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.535376:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.535395:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.535438:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789480067.535500:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.535675:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876405551960576:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480067.536033:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.536059:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147000, rc 0) 00000100:00100000:2.0:1789480067.536140:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551960704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1038us (1235us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789480067.536150:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789480067.536189:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480067.536197:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536209:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480067.536215:0:11176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536227:0:11176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536249:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536257:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c73555f/0xbb972366037fda2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536312:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480067.536314:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480067.536316:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480067.536332:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526766976 00000100:00100000:2.0:1789480067.536340:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526766976 00010000:00010000:2.0:1789480067.536378:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 8 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.536419:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1789480067.536429:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526766976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480067.536444:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789480067.536467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10444:x1876405526766848:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 23682us (27722us total) trans 0 rc 0/0 00010000:00010000:2.0:1789480067.536468:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 8 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.536484:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00010000:00010000:2.0:1789480067.536500:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 7 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536523:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fda1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3281 expref: 7 pid: 6686 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536536:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480067.536540:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480067.536550:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536560:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.536601:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.536632:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551960960:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789480067.536701:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343b240 going to sleep for 11 seconds 00000004:00080000:3.0:1789480067.537007:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22a485f480/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789480067.537015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551960704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789480067.548490:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551960960:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480067.548529:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480067.548638:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526766976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 12209us (13140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480067.548651:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1789480067.549335:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.553689:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526767104 00000100:00100000:1.0:1789480067.553719:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526767104 00002000:00100000:1.0:1789480067.553800:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d22bfdced80 x1876405526767104/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:218/0 lens 504/0 e 0 to 0 dl 1789480078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480067.553812:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bfdced80 with x1876405526767104 ext(0->8) 00002000:00010000:1.0:1789480067.553820:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bfdced80 00000100:00100000:1.0:1789480067.553870:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480067.553880:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526767104:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789480067.559713:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2346:x1876405526767104:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 5823us (10370us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789480067.559783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:1.0:1789480067.559798:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d22bfdced80 x1876405526767104/t4294967303(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:218/0 lens 504/448 e 0 to 0 dl 1789480078 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480067.559809:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bfdced80 with x1876405526767104 ext(0->8) 00002000:00010000:1.0:1789480067.559815:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bfdced80 00000100:00100000:2.0:1789480067.571886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.572090:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526767232 00000100:00100000:1.0:1789480067.572101:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526767232 00000100:00100000:1.0:1789480067.572162:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789480067.572175:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10444:x1876405526767232:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789480067.572321:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10444:x1876405526767232:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 149us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480067.572329:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789480067.575095:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.575207:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526767360 00000100:00100000:2.0:1789480067.575218:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526767360 00000100:00100000:2.0:1789480067.575312:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1789480067.575325:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bad17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2345:x1876405526767360:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789480067.736025:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789480067.736066:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789480067.736236:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bad17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526767360:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 160905us (161145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480067.736250:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1789480067.752807:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.752856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526767616 00000100:00100000:2.0:1789480067.752868:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526767616 00000100:00100000:2.0:1789480067.752934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:2.0:1789480067.752946:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10444:x1876405526767616:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480067.753046:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480067.753083:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fda18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f327a expref: 14 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.753104:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480067.753111:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480067.753160:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.753180:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.753191:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480067.753461:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000204adc2 reply state 0000000013977a7b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.753473:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480067.753614:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+15:10444:x1876405526767616:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 668us (821us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789480067.753622:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:3.0:1789480067.757349:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757374:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757403:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757410:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480067.757416:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757426:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757449:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480067.757453:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480067.757459:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480067.757466:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fda34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.764789:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.766414:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526767744 00000100:00100000:1.0:1789480067.766434:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526767744 00000100:00100000:1.0:1789480067.766526:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1789480067.766554:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526767744:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789480067.766923:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789480067.766928:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789480066 00002000:00010000:1.0:1789480067.766947:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789480064 00002000:00010000:1.0:1789480067.766962:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789480067 -> 1789480066 00002000:00010000:1.0:1789480067.766965:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789480067.767061:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526767744:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 510us (2291us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789480067.767069:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789480067.779867:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.781616:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768000 00000100:00100000:1.0:1789480067.781638:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768000 00000100:00100000:1.0:1789480067.781737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1789480067.781750:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10444:x1876405526768000:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789480067.781849:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.781878:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.781890:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.781935:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.781964:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 14 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.781982:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551961088:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480067.782120:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480067.785466:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551961088:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480067.785506:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480067.786220:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.786465:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768128 00000100:00100000:2.0:1789480067.786476:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768128 00010000:00010000:2.0:1789480067.786522:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 15 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.786577:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789480067.786588:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+15:2347:x1876405526768128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480067.786606:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480067.786613:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 15 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786630:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 15 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786657:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fd9f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f326c expref: 15 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786689:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480067.786695:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786706:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786716:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786740:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480067.786797:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2347:x1876405526768128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 211us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.786804:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00010000:00010000:2.0:1789480067.786915:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786925:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786976:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786983:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786991:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.786998:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.787009:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.787018:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.787027:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480067.787030:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789480067.787034:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.787041:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fda3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.787087:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10444:x1876405526768000:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 5341us (7238us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789480067.787094:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:3.0:1789480067.791046:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480067.791150:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768256 00000100:00100000:2.0:1789480067.791164:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768256 00000100:00100000:2.0:1789480067.791248:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789480067.791261:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2345:x1876405526768256:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789480067.791364:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.791394:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.791405:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480067.791411:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480067.791431:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.791481:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.791501:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 7 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.791518:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876405551961216:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480067.791626:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480067.794663:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876405551961216:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480067.794737:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480067.795255:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.795416:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768384 00000100:00100000:1.0:1789480067.795426:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768384 00010000:00010000:1.0:1789480067.795479:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 8 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.795527:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480067.795539:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526768384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480067.795557:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480067.795588:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 8 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.795606:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 8 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.795639:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a7070d/0xbb972366037fda26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3288 expref: 8 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.795660:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480067.795665:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480067.795671:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.795683:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.795752:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480067.795827:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526768384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 289us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480067.795835:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:2.0:1789480067.796214:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796225:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796259:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796268:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796278:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796331:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480067.796345:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796358:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796375:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.796384:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ef561c/0xbb972366037fda42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.796467:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526768256:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 5209us (5435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.796475:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1789480067.798887:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.798987:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768640 00000100:00100000:1.0:1789480067.798999:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768640 00000100:00100000:1.0:1789480067.799075:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1789480067.799087:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10444:x1876405526768640:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789480067.799218:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799241:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799257:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799636:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799651:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799660:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799702:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.799735:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 14 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480067.799753:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551961344:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480067.799871:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480067.808375:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.808593:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551961344:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480067.808657:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.808692:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768768 00000100:00100000:2.0:1789480067.808708:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768768 00010000:00010000:2.0:1789480067.808761:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 15 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.808812:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789480067.808824:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+15:2347:x1876405526768768:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480067.808844:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480067.808852:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 15 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.808870:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 15 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.808920:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fda03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3273 expref: 15 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.808939:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480067.808945:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.808970:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.808979:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.809084:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480067.809100:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.809110:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.809231:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2347:x1876405526768768:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 407us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.809244:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000001:00080000:1.0:1789480067.809416:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789480067.809601:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789480067.809653:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789480067.810155:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551961472:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789480067.810242:0:11710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480067.810308:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480067.810453:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551961472 00000100:00100000:0.0:1789480067.810462:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551961472 00000100:00100000:0.0:1789480067.810526:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480067.810536:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11710:x1876405551961472:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789480067.810626:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11710:x1876405551961472:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480067.810634:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480067.810738:0:11710:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1789480067.810751:0:11710:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bb2ff480, transno 4294967302 00000100:00100000:2.0:1789480067.810778:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551961472:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789480067.811693:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789480067.811793:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551961600:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789480067.811866:0:11710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480067.811911:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789480067.812363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551961600 00000100:00100000:1.0:1789480067.812376:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551961600 00000100:00100000:1.0:1789480067.812421:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480067.818212:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11710:x1876405551961600:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789480067.819040:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551961600:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789480067.819122:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819154:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819163:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819170:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.819176:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819186:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819210:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480067.819213:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480067.819221:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819228:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fda50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819626:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819635:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819640:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819645:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.819655:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819661:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819671:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:2.0:1789480067.819674:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480067.819677:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819683:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fd97e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819743:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819761:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819772:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819819:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.819843:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 17 pid: 5830 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.819860:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551961728:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480067.820006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11710:x1876405551961600:12345-0@lo:1000:mdt00_004.0 Request processed in 1923us (8133us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789480067.820020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480067.822796:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480067.827827:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551961728:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480067.827892:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480067.828965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480067.829188:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526768896 00000100:00100000:0.0:1789480067.829200:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526768896 00010000:00010000:0.0:1789480067.829258:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 18 pid: 5830 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480067.829360:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1789480067.829372:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+18:2348:x1876405526768896:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480067.829409:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480067.829418:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 18 pid: 5830 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829434:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 18 pid: 5830 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829464:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fd99a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3257 expref: 18 pid: 5830 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829486:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:0.0:1789480067.829491:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829503:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829513:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.829559:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480067.829635:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+17:2348:x1876405526768896:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 265us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480067.829644:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:2.0:1789480067.830556:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830570:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830589:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830597:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830603:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830610:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.830614:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830623:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830636:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:2.0:1789480067.830639:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480067.830643:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830650:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fda57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830681:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830687:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830693:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830699:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480067.830702:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830708:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830716:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf900) 00010000:00010000:2.0:1789480067.830718:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480067.830720:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480067.830726:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480067.831077:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+16:10444:x1876405526768640:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 31988us (32201us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789480067.831088:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000020:00080000:2.0:1789480067.831094:0:11710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789480067.832245:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480067.832255:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480067.832318:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789480067.832435:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480067.839741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480067.840007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769152 00000100:00100000:1.0:1789480067.840025:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769152 00000100:00100000:1.0:1789480067.840112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1789480067.840124:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:10444:x1876405526769152:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789480067.846102:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789480067.846264:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789480067.846383:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846401:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846416:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846426:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846432:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846438:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480067.846454:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789480067.846569:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10444:x1876405526769152:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 6443us (6842us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789480067.846579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000020:00080000:0.0:1789480067.846585:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789480067.848572:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480067.848591:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.848603:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480067.848607:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.848620:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.848641:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2290ce3700) 00010000:00010000:1.0:1789480067.848645:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789480067.848651:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.848657:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fda5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480067.848683:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480067.848686:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480067.848688:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480067.953525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480067.953581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480067.953617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480067.953648:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769280 00000100:00100000:0.0:1789480067.953658:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769280 00000100:00100000:0.0:1789480067.953713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:0.0:1789480067.953724:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526769280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480067.953821:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526769280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480067.953829:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:2.0:1789480067.953908:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769408 00000100:00100000:2.0:1789480067.953914:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769408 00000100:00100000:2.0:1789480067.953986:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1789480067.953994:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526769408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480067.954028:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526769408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.954035:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1789480067.954056:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769536 00000100:00100000:2.0:1789480067.954060:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769536 00000100:00100000:2.0:1789480067.954095:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:2.0:1789480067.954102:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526769536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480067.954142:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526769536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480067.954149:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00080000:0.0:1789480067.954207:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480067.954213:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789480068.185073:0:12009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480068.185084:0:12009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480068.185126:0:12009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789480068.185133:0:12009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789480068.186790:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480068.417710:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480068.418482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769792 00000100:00100000:3.0:1789480068.418493:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769792 00000100:00100000:3.0:1789480068.418583:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:3.0:1789480068.418596:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10455:x1876405526769792:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480068.418642:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480068.418669:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fda65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f328f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.418775:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.418793:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.418804:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480068.418815:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789480068.418956:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fda65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f328f expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.418976:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f328f expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.418985:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480068.418988:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480068.418992:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4200, rc 0) 00000100:00100000:3.0:1789480068.419057:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10455:x1876405526769792:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 465us (1358us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789480068.419064:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00080000:1.0:1789480068.419348:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480068.428365:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480068.428489:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526769920 00000100:00100000:1.0:1789480068.428499:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526769920 00000100:00100000:1.0:1789480068.428573:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:1.0:1789480068.428586:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10455:x1876405526769920:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789480068.428673:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428691:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428704:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428717:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428724:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428730:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428968:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428977:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.428984:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480068.429023:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429034:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429051:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429059:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429065:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480068.429069:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429077:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429088:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480068.429091:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480068.429096:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429103:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fda7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429115:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429120:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429126:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429131:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480068.429138:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429144:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429151:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedf600) 00010000:00010000:1.0:1789480068.429153:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480068.429156:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429161:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fda81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429174:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429180:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429185:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429190:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480068.429193:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429198:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429205:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:1.0:1789480068.429207:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480068.429213:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.429220:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fda88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480068.429316:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10455:x1876405526769920:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 733us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480068.429323:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:2.0:1789480068.488150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.489810:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526770176 00000100:00100000:2.0:1789480068.489834:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526770176 00000100:00100000:2.0:1789480068.489947:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1789480068.489962:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10458:x1876405526770176:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480068.489995:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480068.492018:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fda8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3296 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.492145:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.492163:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.492190:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.493306:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.493327:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.493339:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.493979:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.493990:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.494482:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480068.494497:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789480068.495536:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495564:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495572:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495760:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480068.495775:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495785:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495805:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480068.495808:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480068.495814:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495820:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fda96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495837:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495843:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495849:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495854:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480068.495857:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495863:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495871:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d228804d500) 00010000:00010000:2.0:1789480068.495873:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480068.495884:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495889:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fda9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495971:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fda8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 23 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.495991:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.496053:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:2.0:1789480068.496056:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480068.496059:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffa00, rc 0) 00000100:00100000:2.0:1789480068.496180:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10458:x1876405526770176:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 6220us (8040us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789480068.496192:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1789480068.507611:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.507667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526770304 00000100:00100000:2.0:1789480068.507681:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526770304 00000100:00100000:2.0:1789480068.507753:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:2.0:1789480068.507766:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10458:x1876405526770304:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789480068.507868:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507893:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507910:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507962:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507971:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507979:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.507987:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480068.507992:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.508012:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.508028:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:2.0:1789480068.508032:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480068.508039:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.508047:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480068.508140:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10458:x1876405526770304:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 375us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.508149:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1789480068.521557:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.521605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526770560 00000100:00100000:0.0:1789480068.521616:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526770560 00000100:00100000:0.0:1789480068.521673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480068.521684:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286ead050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10458:x1876405526770560:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480068.521946:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286ead050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:10458:x1876405526770560:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 251us (386us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789480068.521954:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1789480068.574578:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.574746:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526770816 00000100:00100000:0.0:1789480068.574759:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526770816 00000100:00100000:0.0:1789480068.574840:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1789480068.574852:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:9984:x1876405526770816:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480068.574889:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480068.574916:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdab9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f329d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.575073:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.575092:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 24 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.575126:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.575173:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 24 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.575193:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 24 pid: 8260 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480068.575211:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551961856:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480068.575380:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218108a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480068.588575:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.588744:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551961856:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480068.588784:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480068.588913:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526770944 00000100:00100000:1.0:1789480068.588923:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526770944 00010000:00010000:1.0:1789480068.588993:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 25 pid: 8260 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480068.589039:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789480068.589052:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+25:2348:x1876405526770944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480068.589074:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480068.589083:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 25 pid: 8260 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589102:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 25 pid: 8260 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589133:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdaa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3296 expref: 25 pid: 8260 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589153:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:1.0:1789480068.589159:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589184:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589194:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.589231:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480068.589371:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+24:2348:x1876405526770944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 320us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480068.589381:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00010000:00010000:0.0:1789480068.590085:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.590097:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480068.590129:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789480068.590423:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.590447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.590456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:0.0:1789480068.590460:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789480068.590476:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6800, rc 0) 00000100:00100000:0.0:1789480068.590545:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+24:9984:x1876405526770816:12345-192.168.204.54@tcp:101:bash.0 Request processed in 15695us (15982us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789480068.590555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1789480068.596710:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.596815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771200 00000100:00100000:2.0:1789480068.596829:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771200 00000100:00100000:2.0:1789480068.596915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:2.0:1789480068.596928:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:9984:x1876405526771200:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1789480068.597377:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.597401:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.597416:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480068.597478:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789480068.597505:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006487ba5b reply state 000000009176a5e4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480068.597515:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789480068.597568:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789480068.597711:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+28:9984:x1876405526771200:12345-192.168.204.54@tcp:36:bash.0 Request processed in 784us (1015us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789480068.597720:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000020:00080000:2.0:1789480068.597727:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789480068.604258:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604347:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604357:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604365:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480068.604371:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604380:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604404:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:3.0:1789480068.604407:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480068.604414:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.604420:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdace lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480068.604872:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.605078:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771328 00000100:00100000:2.0:1789480068.605091:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771328 00000100:00100000:2.0:1789480068.605173:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789480068.605185:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+27:9984:x1876405526771328:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480068.605221:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480068.605256:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdad5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32a4 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.605379:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32a4 expref: 28 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.605395:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32a4 expref: 28 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.605419:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:2.0:1789480068.605422:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480068.605426:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789480068.605507:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+28:9984:x1876405526771328:12345-192.168.204.54@tcp:101:bash.0 Request processed in 324us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.605582:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1789480068.611711:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.611819:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771456 00000100:00100000:0.0:1789480068.611833:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771456 00000100:00100000:0.0:1789480068.611901:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1789480068.611913:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:9984:x1876405526771456:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480068.611950:0:8279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480068.611980:0:8279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32ab expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480068.612016:0:8279:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94c82, atime: 0x6aa94c80, ctime: 0x6aa94c82, blocks: 0xb 00010000:00010000:0.0:1789480068.612043:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1789480068.612049:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480068.612057:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.612079:0:8279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 7 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.612094:0:8279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6c00, rc 0) 00000100:00100000:0.0:1789480068.612172:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:9984:x1876405526771456:12345-192.168.204.54@tcp:101:bash.0 Request processed in 262us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480068.612180:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1789480068.617787:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.617898:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771584 00000100:00100000:2.0:1789480068.617912:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771584 00002000:00010000:2.0:1789480068.617994:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789480068.618000:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd7aad80 with x1876405526771584 ext(0->18446744073709551615) 00002000:00010000:2.0:1789480068.618019:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd7aad80. 00000100:00100000:2.0:1789480068.618069:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789480068.618084:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526771584:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:2.0:1789480068.618586:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789480068.618591:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789480066 -> 1789480068 00002000:00010000:2.0:1789480068.618594:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789480064 -> 1789480064 00002000:00010000:2.0:1789480068.618597:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789480066 -> 1789480068 00002000:00010000:2.0:1789480068.618599:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789480068.618696:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526771584:12345-192.168.204.54@tcp:10:bash.0 Request processed in 614us (922us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789480068.618706:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00010000:2.0:1789480068.618709:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789480068.618712:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd7aad80 with x1876405526771584 ext(0->18446744073709551615) 00002000:00010000:2.0:1789480068.618719:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd7aad80. 00000100:00100000:1.0:1789480068.705467:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.705598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771712 00000100:00100000:0.0:1789480068.705614:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771712 00000100:00100000:0.0:1789480068.705697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789480068.705709:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:10472:x1876405526771712:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1789480068.705814:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.705837:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.705851:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.705869:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.705877:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.705884:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706257:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706267:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706276:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480068.706381:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706408:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706417:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706426:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706434:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480068.706440:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706450:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706466:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480068.706469:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480068.706476:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706482:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706496:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706502:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706509:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706521:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480068.706524:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706530:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706538:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2290ce3e00) 00010000:00010000:0.0:1789480068.706540:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480068.706543:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706549:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdaea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706566:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706573:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706579:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706584:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480068.706588:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706594:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706612:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:0.0:1789480068.706614:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480068.706618:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480068.706623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fdaf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480068.706740:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:10472:x1876405526771712:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1031us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480068.706750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:1.0:1789480068.793676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480068.793823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526771968 00000100:00100000:3.0:1789480068.793838:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526771968 00000100:00100000:3.0:1789480068.793922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789480068.793945:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:10475:x1876405526771968:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480068.793977:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480068.794016:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdaf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32b2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794143:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794160:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794174:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794212:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794220:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.794227:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.795103:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.795121:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.795131:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480068.795145:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789480068.796979:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797066:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797095:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797102:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480068.797107:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797117:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797138:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480068.797142:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480068.797149:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797157:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdaff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797437:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797445:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797452:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797457:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480068.797460:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797478:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797489:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22b7076300) 00010000:00010000:3.0:1789480068.797491:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480068.797496:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797502:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797847:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdaf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b2 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797865:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b2 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.797874:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:3.0:1789480068.797877:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480068.797880:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480068.797983:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10475:x1876405526771968:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4050us (4324us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789480068.798059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789480068.807059:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.812549:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772096 00000100:00100000:0.0:1789480068.813138:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772096 00000100:00100000:1.0:1789480068.813668:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1789480068.813685:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10475:x1876405526772096:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789480068.813783:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.813808:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.813819:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.813870:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480068.813890:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 30 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480068.813928:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551961984:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480068.814253:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480068.827471:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551961984:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480068.827520:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789480068.827529:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480068.827616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772352 00000100:00100000:1.0:1789480068.827627:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772352 00000100:00100000:1.0:1789480068.827741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789480068.827754:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+31:5588:x1876405526772352:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480068.828255:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+32:5588:x1876405526772352:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 501us (736us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789480068.828265:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1789480068.835034:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480068.835199:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772480 00000100:00100000:2.0:1789480068.835213:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772480 00010000:00010000:2.0:1789480068.835270:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 32 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480068.835338:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1789480068.835446:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:2348:x1876405526772480:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480068.835467:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480068.835476:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 32 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835495:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 32 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835523:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdac0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f329d expref: 32 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835543:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:2.0:1789480068.835548:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835561:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835590:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480068.835634:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480068.835715:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:2348:x1876405526772480:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 366us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.835723:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:3.0:1789480068.841251:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841276:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841377:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841386:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841395:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841402:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480068.841407:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841415:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841436:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:3.0:1789480068.841440:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480068.841447:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480068.841454:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480068.841638:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10475:x1876405526772096:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 27949us (34587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.841651:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1789480068.851587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480068.852451:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772736 00000100:00100000:0.0:1789480068.852466:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772736 00000100:00100000:0.0:1789480068.852557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789480068.852571:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+30:10475:x1876405526772736:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480068.853143:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:10475:x1876405526772736:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 573us (1568us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789480068.853154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789480068.978357:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480068.978413:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480068.978450:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772864 00000100:00100000:1.0:1789480068.978463:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772864 00002000:00100000:1.0:1789480068.978545:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8d22bb2fd180 x1876405526772864/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:219/0 lens 496/0 e 0 to 0 dl 1789480079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480068.978557:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb2fd180 with x1876405526772864 ext(0->7) 00002000:00010000:1.0:1789480068.978564:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bb2fd180 00000100:00100000:1.0:1789480068.978596:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789480068.978606:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2345:x1876405526772864:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:3.0:1789480068.979725:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526772992 00000100:00100000:3.0:1789480068.979736:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526772992 00000100:00100000:3.0:1789480068.979819:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1789480068.979830:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2345:x1876405526772992:12345-192.168.204.54@tcp:16:kworker.0 00000100:00100000:1.0:1789480068.982473:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2345:x1876405526772864:12345-192.168.204.54@tcp:4:bash.0 Request processed in 3849us (4041us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789480068.982493:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:1.0:1789480068.982512:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8d22bb2fd180 x1876405526772864/t4294967307(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:219/0 lens 496/448 e 0 to 0 dl 1789480079 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480068.982534:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb2fd180 with x1876405526772864 ext(0->7) 00002000:00010000:1.0:1789480068.982544:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bb2fd180 00000100:00100000:1.0:1789480069.063586:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.063656:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526773248 00000100:00100000:1.0:1789480069.063667:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526773248 00000100:00100000:1.0:1789480069.063736:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1789480069.063754:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:10486:x1876405526773248:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789480069.063781:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480069.063809:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32b9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064196:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064213:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064230:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064250:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064258:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064266:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064801:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064811:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.064819:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480069.064829:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789480069.065801:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065815:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065822:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065828:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480069.065833:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065841:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065858:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480069.065861:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480069.065867:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.065892:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068660:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068670:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068677:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068683:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480069.068688:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068696:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068711:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedfa00) 00010000:00010000:1.0:1789480069.068714:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480069.068720:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068726:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdb30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068799:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b9 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068815:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b9 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.068839:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:1.0:1789480069.068841:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480069.068845:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147c00, rc 0) 00000100:00100000:1.0:1789480069.068946:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+33:10486:x1876405526773248:12345-192.168.204.54@tcp:101:cat.0 Request processed in 5200us (5369us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789480069.068955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000001:00080000:0.0:1789480069.070986:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1789480069.071016:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1789480069.071024:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789480069.081494:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.084987:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526773504 00000100:00100000:1.0:1789480069.085011:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526773504 00000100:00100000:0.0:1789480069.085638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789480069.085652:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+33:10486:x1876405526773504:12345-192.168.204.54@tcp:35:cat.0 00000001:00080000:1.0:1789480069.085722:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789480069.085742:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1789480069.086053:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:10486:x1876405526773504:12345-192.168.204.54@tcp:35:cat.0 Request processed in 401us (4575us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789480069.086127:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526772992:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 106298us (107785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480069.086139:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1789480069.086495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789480069.119569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480069.119764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526773760 00000100:00100000:3.0:1789480069.119779:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526773760 00000100:00100000:3.0:1789480069.119862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1789480069.119875:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+34:10487:x1876405526773760:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:3.0:1789480069.119965:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789480069.120002:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b9 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32b2 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120046:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdad5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32a4 expref: 32 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120084:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d228804df00) 00010000:00010000:3.0:1789480069.120100:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480069.120129:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120146:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120159:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120176:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120183:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120189:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120604:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120614:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.120622:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480069.121362:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789480069.121377:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362118093368ns, next at 363118089473ns, rc = 0 00010000:00010000:2.0:1789480069.122037:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122057:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122070:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122080:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122088:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122094:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122123:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480069.122153:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122172:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122179:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122185:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480069.122191:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122205:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122220:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:2.0:1789480069.122223:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789480069.122229:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122235:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdb53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122263:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122268:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122274:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122278:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480069.122325:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122332:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122341:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480069.122343:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480069.122346:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.122352:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480069.122363:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a2d4578 reply state 00000000cd72266b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480069.122372:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480069.122506:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+33:10487:x1876405526773760:12345-192.168.204.54@tcp:36:rm.0 Request processed in 2627us (2945us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789480069.122578:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00010000:00010000:3.0:1789480069.126056:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480069.126076:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.126091:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480069.126096:0:11176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.126111:0:11176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.126135:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480069.126139:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480069.126145:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.126152:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdb5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.126184:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480069.126186:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480069.126188:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480069.127360:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127379:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127388:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127394:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480069.127419:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127428:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127443:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22b7076300) 00010000:00010000:3.0:1789480069.127446:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480069.127451:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.127457:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480069.208767:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480069.209402:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774016 00000100:00100000:3.0:1789480069.209418:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774016 00000100:00100000:3.0:1789480069.209508:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:3.0:1789480069.209608:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+32:10493:x1876405526774016:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480069.209641:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480069.209668:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32c0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.209995:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.210015:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.210030:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.210060:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.210069:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.210076:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.210481:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789480069.212093:0:8260:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789480069.212422:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.212443:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.212458:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213049:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213060:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213068:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213076:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480069.213081:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213112:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213129:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480069.213132:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480069.213138:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213145:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdb68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480069.213168:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c100157f reply state 00000000a44b3185 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480069.213179:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789480069.213246:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdb61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 35 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213266:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 34 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.213275:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480069.213277:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480069.213396:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480069.213581:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10493:x1876405526774016:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3909us (4775us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789480069.213592:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1789480069.221355:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789480069.221705:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221740:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221749:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221770:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480069.221777:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221786:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221809:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22b7076300) 00010000:00010000:3.0:1789480069.221813:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480069.221819:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.221826:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdb6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480069.222016:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774144 00000100:00100000:0.0:1789480069.222030:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774144 00000100:00100000:0.0:1789480069.222133:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1789480069.222147:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526774144:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480069.222168:0:8279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480069.222193:0:8279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32c7 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480069.222225:0:8279:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480069.222252:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1789480069.222257:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480069.222270:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 6 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.222332:0:8279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 6 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.222346:0:8279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7800, rc 0) 00000100:00100000:0.0:1789480069.222429:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526774144:12345-192.168.204.54@tcp:101:bash.0 Request processed in 285us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.222437:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00080000:1.0:1789480069.222696:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480069.230840:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.231120:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774272 00000100:00100000:0.0:1789480069.231135:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774272 00000100:00100000:0.0:1789480069.231218:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789480069.231230:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:10493:x1876405526774272:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480069.231279:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480069.231353:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32ce expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.231399:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.231411:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480069.231415:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480069.231421:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.231469:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.231489:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480069.231507:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876405551962112:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480069.231721:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22953c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789480069.235487:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.236218:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876405551962112:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480069.236272:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.236328:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7200, rc 0) 00000100:00100000:0.0:1789480069.236448:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:10493:x1876405526774272:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5220us (5625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.236459:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1789480069.244181:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774400 00000100:00100000:1.0:1789480069.244204:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774400 00010000:00010000:1.0:1789480069.244297:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480069.244365:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789480069.244378:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526774400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480069.244398:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480069.244433:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.244454:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.244519:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fdb84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c7 expref: 7 pid: 8279 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.244542:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480069.244548:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480069.244559:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.244572:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.244628:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480069.244646:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1876405551962240:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480069.245100:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480069.249258:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1876405551962240:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480069.249339:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480069.249413:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526774400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5037us (13940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.249426:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1789480069.250278:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.251111:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774656 00000100:00100000:0.0:1789480069.251125:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774656 00000100:00100000:0.0:1789480069.251198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1789480069.251209:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:10493:x1876405526774656:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1789480069.251745:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10493:x1876405526774656:12345-192.168.204.54@tcp:35:bash.0 Request processed in 536us (1470us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789480069.253164:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1789480069.455613:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.455783:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526774784 00000100:00100000:1.0:1789480069.455797:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526774784 00000100:00100000:1.0:1789480069.455877:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1789480069.455907:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:10509:x1876405526774784:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480069.455953:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480069.455990:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32d5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456078:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456097:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456112:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480069.456157:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789480069.456162:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480069.456183:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456227:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdb92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32d5 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456250:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32d5 expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.456259:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480069.456263:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480069.456267:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146a00, rc 0) 00000100:00100000:1.0:1789480069.456481:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+36:10509:x1876405526774784:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 576us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.456776:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1789480069.467211:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480069.467583:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775040 00000100:00100000:2.0:1789480069.467600:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775040 00000100:00100000:2.0:1789480069.467679:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:2.0:1789480069.467692:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+36:10509:x1876405526775040:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480069.467722:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480069.467750:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32dc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.467933:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.467952:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.467967:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480069.467990:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789480069.468165:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32dc expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.468187:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32dc expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.468197:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:2.0:1789480069.468200:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480069.468205:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480069.468327:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+38:10509:x1876405526775040:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 639us (1132us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789480069.468336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1789480069.468857:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551962368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480069.468937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480069.470055:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551962368 00000100:00100000:3.0:1789480069.470068:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551962368 00000100:00100000:3.0:1789480069.470164:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789480069.470174:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551962368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480069.470223:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480069.470380:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551962368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480069.470389:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789480069.470776:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480069.470825:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789480069.470833:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789480069.470862:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22a485f480, transno 4294967301 00000100:00100000:1.0:1789480069.470901:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551962368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480069.475825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480069.475885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.476002:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775424 00000100:00100000:1.0:1789480069.476015:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775424 00000100:00100000:1.0:1789480069.476105:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789480069.476118:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+38:2348:x1876405526775424:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480069.476139:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480069.476174:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32dc expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.476194:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:1.0:1789480069.476200:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480069.476262:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+37:2348:x1876405526775424:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 147us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.476269:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1789480069.477750:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775296 00000100:00100000:3.0:1789480069.477763:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775296 00000100:00100000:3.0:1789480069.477834:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:3.0:1789480069.477845:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+37:10509:x1876405526775296:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480069.477878:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480069.477904:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdbb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32e3 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.478056:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.478074:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.478087:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480069.478101:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789480069.479858:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdbb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32e3 expref: 40 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.479886:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32e3 expref: 39 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.479896:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480069.479899:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789480069.479928:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4a00, rc 0) 00000100:00100000:3.0:1789480069.480029:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+39:10509:x1876405526775296:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2184us (4219us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789480069.480040:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1789480069.488961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.489078:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775552 00000100:00100000:0.0:1789480069.489092:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775552 00000100:00100000:0.0:1789480069.489171:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1789480069.489184:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526775552:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1789480069.489245:0:8279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.489270:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.489314:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480069.489320:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480069.489324:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.489369:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.489408:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 6 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480069.489428:0:8279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551962496:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480069.489559:0:8279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22953c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480069.494417:0:8279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551962496:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480069.494462:0:8279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480069.498683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480069.498808:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775680 00000100:00100000:3.0:1789480069.498822:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775680 00002000:00100000:3.0:1789480069.498894:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d22ba948000 x1876405526775680/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:220/0 lens 504/0 e 0 to 0 dl 1789480080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480069.498908:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22ba948000 with x1876405526775680 ext(0->8) 00010000:00010000:3.0:1789480069.498931:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 7 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.498957:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 7 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480069.498967:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22ba948000 00000100:00100000:3.0:1789480069.499010:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1789480069.499022:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526775680:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:3.0:1789480069.499766:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526775680:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 740us (1095us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789480069.499776:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00100000:3.0:1789480069.499787:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d22ba948000 x1876405526775680/t4294967302(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:220/0 lens 504/448 e 0 to 0 dl 1789480080 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480069.499796:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22ba948000 with x1876405526775680 ext(0->8) 00010000:00010000:3.0:1789480069.499804:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.499828:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480069.499836:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22ba948000 00000100:00100000:3.0:1789480069.503764:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.503895:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526775808 00000100:00100000:1.0:1789480069.503909:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526775808 00010000:00010000:1.0:1789480069.503988:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480069.504076:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1789480069.504088:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526775808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480069.504110:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789480069.504139:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789480069.504143:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789480069 00002000:00010000:1.0:1789480069.504145:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789480069 00002000:00010000:1.0:1789480069.504148:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789480069 00010000:00010000:1.0:1789480069.504155:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.504175:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.504204:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1918948/0xbb972366037fdb8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ce expref: 9 pid: 6687 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.504226:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480069.504232:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480069.504239:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.504251:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.504349:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480069.504429:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526775808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 343us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.504438:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00010000:00010000:3.0:1789480069.505032:0:8279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505048:0:8279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505089:0:8279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505097:0:8279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505107:0:8279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505114:0:8279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480069.505120:0:8279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505130:0:8279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505166:0:8279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.505174:0:8279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fdbca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480069.505264:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526775552:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 16080us (16317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480069.505273:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1789480069.514342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480069.514444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776064 00000100:00100000:2.0:1789480069.514458:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776064 00000100:00100000:2.0:1789480069.514540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789480069.514554:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+39:10509:x1876405526776064:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:2.0:1789480069.514642:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32e3 expref: 39 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480069.515044:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789480069.515093:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789480069.515529:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789480069.515600:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.515621:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.515631:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.515679:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.515700:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 43 pid: 8260 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480069.515715:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876405551962624:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480069.515849:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789480069.523858:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba94a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876405551962624:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480069.523901:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480069.525798:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.526543:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776192 00000100:00100000:1.0:1789480069.526556:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776192 00010000:00010000:1.0:1789480069.526610:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 44 pid: 8260 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480069.526657:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1789480069.526667:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+44:2348:x1876405526776192:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480069.526685:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480069.526692:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 44 pid: 8260 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526711:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 44 pid: 8260 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526738:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fdb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32c0 expref: 44 pid: 8260 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526762:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:1.0:1789480069.526769:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526781:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526790:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.526846:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480069.526931:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+43:2348:x1876405526776192:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 265us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.526940:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00010000:00010000:0.0:1789480069.527126:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.527136:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480069.527359:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789480069.527650:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789480069.527804:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551962752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789480069.527885:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480069.527943:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480069.529667:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551962752 00000100:00100000:1.0:1789480069.529686:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551962752 00000100:00100000:1.0:1789480069.529758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789480069.529770:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551962752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789480069.529940:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551962752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 172us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480069.529949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480069.530183:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551962752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789480069.530871:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789480069.530998:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551962880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789480069.531059:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480069.531093:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480069.531627:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551962880 00000100:00100000:0.0:1789480069.531635:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551962880 00000100:00100000:0.0:1789480069.531679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789480069.531687:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551962880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789480069.531938:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876405551962880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 251us (878us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789480069.531946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480069.532195:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551962880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789480069.533204:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789480069.533327:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533342:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533350:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533375:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480069.533382:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533391:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533413:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480069.533418:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789480069.533425:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.533431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdbd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480069.533704:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789480069.533823:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789480069.533838:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362530554708ns, next at 363530552010ns, rc = 0 00000001:00080000:3.0:1789480069.533846:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789480069.533887:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480069.533891:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789480069.533901:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdbbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32e3 expref: 47 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480069.534077:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+46:10509:x1876405526776064:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 19525us (19800us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789480069.534088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000020:00080000:3.0:1789480069.534095:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789480069.539825:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.539937:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776320 00000100:00100000:0.0:1789480069.539951:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776320 00000100:00100000:0.0:1789480069.540186:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:0.0:1789480069.540233:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+46:10509:x1876405526776320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480069.540268:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480069.540329:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fdbd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.540415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fdbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ea expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.540433:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fdbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ea expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.540458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480069.540461:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480069.540466:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480069.540558:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10509:x1876405526776320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 329us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.540566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1789480069.547987:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.548123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776576 00000100:00100000:0.0:1789480069.548136:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776576 00000100:00100000:0.0:1789480069.548218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789480069.548230:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+47:10509:x1876405526776576:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480069.548605:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10509:x1876405526776576:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 375us (640us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789480069.548614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1789480069.664732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.669112:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776704 00000100:00100000:1.0:1789480069.669154:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776704 00000100:00100000:0.0:1789480069.669584:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:0.0:1789480069.669600:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10519:x1876405526776704:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1789480069.669746:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669772:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669787:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669817:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669824:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669831:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669971:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669990:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.669999:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480069.670058:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670074:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670093:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670100:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670106:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480069.670111:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670121:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670135:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:0.0:1789480069.670138:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480069.670144:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670150:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fdbdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670165:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670171:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670176:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670181:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480069.670190:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670197:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670204:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2290ce3f00) 00010000:00010000:0.0:1789480069.670206:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480069.670209:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670216:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fdbe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670233:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670239:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670245:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670249:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480069.670252:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670258:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670265:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480069.670267:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480069.670278:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.670358:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdbed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480069.671969:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10519:x1876405526776704:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2356us (7236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.671995:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1789480069.729946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480069.730489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526776960 00000100:00100000:1.0:1789480069.730568:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526776960 00000100:00100000:1.0:1789480069.730690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789480069.730704:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+48:10522:x1876405526776960:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480069.730732:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480069.730760:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdbf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730862:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730880:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730929:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730948:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730955:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.730962:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731130:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdc09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731139:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdc09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731146:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdc09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480069.731157:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789480069.731343:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731351:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731359:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731366:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480069.731378:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731388:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731403:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480069.731406:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480069.731412:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731419:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdbfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731438:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731445:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731451:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731456:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480069.731459:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731465:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731473:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedfa00) 00010000:00010000:1.0:1789480069.731475:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480069.731485:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731559:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdbf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f1 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731576:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdc09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f1 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.731583:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480069.731586:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480069.731588:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147600, rc 0) 00000100:00100000:1.0:1789480069.731682:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10522:x1876405526776960:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 981us (1751us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789480069.731690:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789480069.735890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.736557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526777088 00000100:00100000:0.0:1789480069.736573:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526777088 00000100:00100000:0.0:1789480069.736656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:0.0:1789480069.736668:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10522:x1876405526777088:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789480069.736760:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736783:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736798:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736831:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736840:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736849:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736856:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480069.736878:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736887:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736902:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480069.736906:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480069.736922:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480069.736931:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdc17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480069.737055:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10522:x1876405526777088:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 388us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.737063:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1789480069.741656:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.742053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526777344 00000100:00100000:0.0:1789480069.742066:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526777344 00000100:00100000:0.0:1789480069.742137:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1789480069.742149:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:10522:x1876405526777344:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480069.742483:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10522:x1876405526777344:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 335us (842us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789480069.742505:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1789480069.846050:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480069.849058:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526777600 00000100:00100000:0.0:1789480069.849079:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526777600 00000100:00100000:1.0:1789480069.852920:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:1.0:1789480069.852941:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+51:10532:x1876405526777600:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789480069.852978:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480069.852983:0:11710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789480069.853026:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32d5 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853057:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480069.853064:0:11710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480069.853104:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32f8 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853250:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdc25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853267:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdc25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853278:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdc25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480069.853349:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789480069.853559:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f8 expref: 53 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853575:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdc25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f8 expref: 52 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480069.853582:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480069.853585:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480069.853587:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147000, rc 0) 00000100:00100000:1.0:1789480069.853685:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10532:x1876405526777600:12345-192.168.204.54@tcp:101:bash.0 Request processed in 749us (7651us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789480069.853693:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:1.0:1789480069.860011:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480069.860159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526777856 00000100:00100000:2.0:1789480069.860172:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526777856 00000100:00100000:2.0:1789480069.860251:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1789480069.860263:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10532:x1876405526777856:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1789480069.860374:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789480069.860412:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdc25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f8 expref: 52 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.860453:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdc09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32f1 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.860465:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480069.860471:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480069.860958:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.860977:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480069.860990:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480069.861073:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789480069.861103:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000306338a8 reply state 00000000935e9b3e transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480069.861113:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480069.861906:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10532:x1876405526777856:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1639us (1905us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789480069.861926:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000020:00080000:2.0:1789480069.861934:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480069.868687:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868711:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868720:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868726:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480069.868732:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868741:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868766:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480069.868769:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480069.868776:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.868782:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480069.873012:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480069.873207:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526777984 00000100:00100000:3.0:1789480069.873221:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526777984 00000100:00100000:3.0:1789480069.873337:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:3.0:1789480069.873350:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+52:10532:x1876405526777984:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480069.873383:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480069.873411:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f32ff expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873565:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873583:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873596:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480069.873631:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789480069.873636:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480069.873657:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873687:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 54 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873709:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 53 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480069.873718:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480069.873721:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480069.873725:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:3.0:1789480069.873803:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10532:x1876405526777984:12345-192.168.204.54@tcp:101:bash.0 Request processed in 455us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480069.873811:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1789480069.885988:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480069.887939:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526778240 00000100:00100000:2.0:1789480069.887959:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526778240 00000100:00100000:2.0:1789480069.888135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1789480069.888149:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+53:10532:x1876405526778240:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1789480069.888846:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10532:x1876405526778240:12345-192.168.204.54@tcp:35:bash.0 Request processed in 696us (2871us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789480069.888856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1789480069.982263:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480069.982323:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551963008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480069.982424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480069.983205:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551963008 00000100:00100000:0.0:1789480069.983218:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551963008 00000100:00100000:0.0:1789480069.983330:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789480069.983361:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551963008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480069.983419:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480069.983516:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551963008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.983523:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789480069.983743:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789480069.983751:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1789480069.983810:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551963008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789480069.984105:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480070.021812:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480070.022019:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526778368 00000100:00100000:1.0:1789480070.022032:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526778368 00000100:00100000:1.0:1789480070.022155:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1789480070.022169:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+54:10538:x1876405526778368:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480070.022203:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480070.022240:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdc48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3306 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022374:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022393:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022409:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480070.022456:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789480070.022460:0:11710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480070.022480:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022521:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdc48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3306 expref: 56 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022542:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3306 expref: 55 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.022551:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:1.0:1789480070.022554:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480070.022559:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146600, rc 0) 00000100:00100000:1.0:1789480070.022949:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526778368:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 781us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480070.022968:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00080000:0.0:1789480070.023703:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480070.039064:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480070.046794:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526778496 00000100:00100000:2.0:1789480070.046823:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526778496 00000100:00100000:2.0:1789480070.046945:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:2.0:1789480070.046960:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526778496:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480070.046991:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480070.047021:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdc56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f330d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047144:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047163:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047176:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047193:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047201:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047208:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047355:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047366:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047373:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480070.047418:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789480070.047423:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480070.047460:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047498:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047509:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047516:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047522:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.047528:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480070.048337:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048351:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048369:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480070.048372:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480070.048379:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048387:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdc5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048406:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048413:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048446:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048451:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480070.048454:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048460:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048468:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d228804dd00) 00010000:00010000:2.0:1789480070.048471:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480070.048475:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048480:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048605:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdc56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f330d expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048622:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f330d expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.048629:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480070.048631:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480070.048634:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffec00, rc 0) 00000100:00100000:2.0:1789480070.048814:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10538:x1876405526778496:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1855us (9764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480070.048832:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1789480070.065099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480070.065158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480070.068689:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526778880 00000100:00100000:1.0:1789480070.068712:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526778880 00000100:00100000:1.0:1789480070.068840:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789480070.068854:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+56:2347:x1876405526778880:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480070.068876:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480070.068919:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fdc6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f330d expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.068946:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480070.068952:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480070.069046:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+55:2347:x1876405526778880:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 195us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480070.069055:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480070.069377:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526778752 00000100:00100000:2.0:1789480070.069383:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526778752 00000100:00100000:2.0:1789480070.069437:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:2.0:1789480070.069446:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526778752:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480070.069469:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480070.069501:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdc72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3314 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.069648:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.069666:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 56 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.069676:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.069719:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 56 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.069739:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 56 pid: 8260 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480070.069755:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551963136:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480070.069858:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480070.081155:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551963136:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480070.081202:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480070.082012:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480070.082051:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779008 00000100:00100000:2.0:1789480070.082082:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779008 00010000:00010000:2.0:1789480070.082139:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 57 pid: 8260 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480070.082190:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789480070.082201:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:2347:x1876405526779008:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480070.082221:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480070.082229:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 57 pid: 8260 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082247:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 57 pid: 8260 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082277:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdc41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ff expref: 57 pid: 8260 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082349:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480070.082355:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082367:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082376:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.082411:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480070.082479:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+56:2347:x1876405526779008:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 279us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480070.082497:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:3.0:1789480070.083606:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.083620:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480070.083649:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789480070.083903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdc72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.083938:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.083947:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480070.083950:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480070.083955:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:3.0:1789480070.084268:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10538:x1876405526778752:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 14821us (19184us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789480070.084278:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:3.0:1789480070.099720:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480070.099831:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779264 00000100:00100000:2.0:1789480070.099845:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779264 00000100:00100000:2.0:1789480070.099954:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789480070.099967:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10538:x1876405526779264:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1789480070.099988:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480070.100023:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fdbd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ea expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480070.100051:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480070.100058:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480070.100135:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526779264:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 171us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480070.100143:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480070.105655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480070.105767:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779392 00000100:00100000:2.0:1789480070.105783:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779392 00000100:00100000:2.0:1789480070.105869:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:2.0:1789480070.106143:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526779392:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:3.0:1789480070.106556:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.106582:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.106612:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480070.107090:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789480070.107317:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526779392:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1402us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480070.107329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:0.0:1789480070.111188:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480070.111498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779520 00000100:00100000:2.0:1789480070.111513:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779520 00000100:00100000:0.0:1789480070.111732:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1789480070.111744:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+55:10538:x1876405526779520:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480070.111787:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480070.111817:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f331b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.111919:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.111930:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.111953:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.111971:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.111987:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480070.112009:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480070.112015:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480070.112024:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480070.112117:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10538:x1876405526779520:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 375us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480070.112126:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00010000:00010000:2.0:1789480070.234655:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480070.939131:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480070.939147:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480070.939196:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789480070.939204:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480070.939404:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551963264:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480070.941054:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480070.953126:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480070.953498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779648 00000100:00100000:3.0:1789480070.953511:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779648 00000100:00100000:3.0:1789480070.953618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:3.0:1789480070.953630:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526779648:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1789480070.953637:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551963264:192.168.204.54@tcp:107:hsm_cdtr.0 00000004:00000080:3.0:1789480070.953674:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480070.953814:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526779648:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 185us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480070.953822:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1789480070.959795:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480070.959935:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526779776 00000100:00100000:3.0:1789480070.959948:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526779776 00000100:00100000:3.0:1789480070.960026:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:3.0:1789480070.960039:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10539:x1876405526779776:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789480070.960143:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.960164:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.960178:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964853:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964877:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964900:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964940:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964950:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.964957:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480070.965004:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789480070.965009:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480070.965024:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965036:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965043:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965050:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965078:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480070.965082:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965090:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965105:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:3.0:1789480070.965108:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480070.965112:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965119:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdc95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965136:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965142:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965148:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965152:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480070.965155:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965160:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965180:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d22b7076b00) 00010000:00010000:3.0:1789480070.965182:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480070.965185:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965190:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdc9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965207:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965213:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.965219:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.966126:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480070.966131:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.966139:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.966152:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480070.966154:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480070.966159:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480070.966164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480070.966299:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10539:x1876405526779776:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 6245us (6503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480070.966310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1789480070.974812:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480070.975063:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526780032 00000100:00100000:1.0:1789480070.975074:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526780032 00000100:00100000:1.0:1789480070.975139:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:1.0:1789480070.975149:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+56:10539:x1876405526780032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480070.975170:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480070.975192:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdcaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3322 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975353:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975369:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975382:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480070.975394:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789480070.975500:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975508:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975515:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975521:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480070.975525:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975532:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975544:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480070.975547:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789480070.975552:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975568:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdcb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975812:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdcaa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3322 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975823:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:1.0:1789480070.975826:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480070.975829:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdcaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3322 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480070.975839:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146a00, rc 0) 00000100:00100000:1.0:1789480070.976048:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780032:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 899us (1245us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789480070.976057:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1789480070.989242:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480070.989413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526780160 00000100:00100000:3.0:1789480070.989423:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526780160 00000100:00100000:3.0:1789480070.989491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:3.0:1789480070.989501:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780160:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480070.989567:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480070.989677:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780160:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 176us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480070.989685:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1789480071.008824:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.009109:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526780416 00000100:00100000:3.0:1789480071.009120:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526780416 00000100:00100000:3.0:1789480071.009180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1789480071.009190:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780416:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.009211:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.009214:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480071.009244:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdc4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3306 expref: 57 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.009262:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480071.009267:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480071.009324:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3329 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480071.009755:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789480071.010192:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdcc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.010206:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.010216:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.010270:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3329 expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.010593:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdcc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3329 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.010602:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480071.010604:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480071.010607:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:0.0:1789480071.015615:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10539:x1876405526780416:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6411us (6786us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789480071.015629:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1789480071.029322:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.029405:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526780672 00000100:00100000:3.0:1789480071.029416:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526780672 00000100:00100000:3.0:1789480071.029469:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789480071.029478:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10539:x1876405526780672:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.029538:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480071.029566:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdcc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3329 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029607:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22b7076b00) 00010000:00010000:3.0:1789480071.029623:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480071.029643:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029657:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029667:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029680:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029688:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029694:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029759:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029767:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029775:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029781:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480071.029785:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029802:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029811:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480071.029814:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.029818:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029823:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029832:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029838:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029843:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029849:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480071.029852:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029857:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029864:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x59befcee (ffff8d22b7076300) 00010000:00010000:3.0:1789480071.029866:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.029883:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.029912:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x59befcee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.029994:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780672:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 516us (717us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789480071.030001:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1789480071.036170:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.036322:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526780800 00000100:00100000:1.0:1789480071.036333:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526780800 00000100:00100000:1.0:1789480071.036397:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789480071.036408:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+57:10539:x1876405526780800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480071.036429:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480071.036450:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdce2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3330 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036486:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036499:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036526:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036623:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 59 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036641:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 58 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.036649:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:1.0:1789480071.036651:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789480071.036655:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147600, rc 0) 00000100:00100000:1.0:1789480071.040145:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10539:x1876405526780800:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3727us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480071.040158:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1789480071.047419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.047545:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781056 00000100:00100000:2.0:1789480071.047556:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781056 00000100:00100000:2.0:1789480071.047625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1789480071.047637:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+58:10539:x1876405526781056:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480071.047737:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.047758:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.047772:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480071.048371:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789480071.048381:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364045098214ns, next at 365045095999ns, rc = 0 00000004:00010000:2.0:1789480071.048471:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000311784ac reply state 000000006af34284 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.048481:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480071.048578:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+60:10539:x1876405526781056:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 943us (1168us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789480071.048586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1789480071.056276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.056436:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781184 00000100:00100000:3.0:1789480071.056447:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781184 00000100:00100000:3.0:1789480071.056501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1789480071.056907:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+60:10539:x1876405526781184:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.056935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.056960:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3337 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.057024:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.057040:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.057061:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:3.0:1789480071.057064:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480071.057068:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5400, rc 0) 00000100:00100000:3.0:1789480071.057139:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+61:10539:x1876405526781184:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 630us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.057164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00010000:00010000:1.0:1789480071.060522:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060541:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060549:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060557:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480071.060562:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060570:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060604:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:1.0:1789480071.060607:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789480071.060613:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.060620:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdcf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.065417:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480071.065649:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781312 00000100:00100000:0.0:1789480071.065661:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781312 00000100:00100000:0.0:1789480071.065747:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1789480071.065759:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526781312:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789480071.066131:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526781312:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 373us (722us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789480071.066139:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00080000:1.0:1789480071.066304:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480071.076099:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.076662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781568 00000100:00100000:3.0:1789480071.076673:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781568 00000100:00100000:3.0:1789480071.076747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1789480071.076757:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+60:10539:x1876405526781568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480071.077239:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+61:10539:x1876405526781568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 482us (1148us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789480071.077248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1789480071.081790:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.081942:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781824 00000100:00100000:1.0:1789480071.081959:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781824 00000100:00100000:1.0:1789480071.082054:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:1.0:1789480071.082065:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+61:10539:x1876405526781824:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480071.082196:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+61:10539:x1876405526781824:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 132us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480071.082203:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1789480071.087143:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.087242:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526781952 00000100:00100000:3.0:1789480071.087252:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526781952 00000100:00100000:3.0:1789480071.087334:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1789480071.087345:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+61:10539:x1876405526781952:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.087366:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.087387:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f333e expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087481:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087496:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087508:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480071.087559:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480071.087578:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087604:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdcfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f333e expref: 63 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087625:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f333e expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.087633:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:3.0:1789480071.087636:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480071.087640:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:0.0:1789480071.088837:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+62:10539:x1876405526781952:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1488us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.088846:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1789480071.092721:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.092840:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782080 00000100:00100000:2.0:1789480071.092851:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782080 00000100:00100000:2.0:1789480071.093428:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789480071.093439:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526782080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480071.093472:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480071.093537:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3345 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480071.093566:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c87, blocks: 0x1 00010000:00010000:2.0:1789480071.093786:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1789480071.093793:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480071.093804:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.093825:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.093838:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789480071.094087:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526782080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 648us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.094096:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480071.106121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.106407:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782336 00000100:00100000:1.0:1789480071.106419:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782336 00000100:00100000:1.0:1789480071.106498:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:1.0:1789480071.106510:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+62:10539:x1876405526782336:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480071.106641:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+62:10539:x1876405526782336:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 133us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480071.106789:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789480071.110676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.110812:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782464 00000100:00100000:3.0:1789480071.110822:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782464 00000100:00100000:3.0:1789480071.110901:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1789480071.110912:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:10539:x1876405526782464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.110931:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.110961:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f334c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.110998:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.111007:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480071.111027:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480071.111033:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.111068:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.111085:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.111100:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288eda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551963392:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480071.111216:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c7b8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480071.120317:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288eda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551963392:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480071.120361:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.120382:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480071.120433:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:10539:x1876405526782464:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 9523us (9766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.120443:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1789480071.122033:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.130997:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782592 00000100:00100000:1.0:1789480071.131015:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782592 00010000:00010000:1.0:1789480071.131072:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.135627:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1789480071.135657:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526782592:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480071.135682:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480071.135712:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.135732:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.135757:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003930c2c4/0xbb972366037fdd0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3345 expref: 9 pid: 6686 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.135776:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480071.135780:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480071.135789:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.135798:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.135843:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.135858:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8453:1876405551963520:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480071.135981:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789480071.139244:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8453:1876405551963520:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480071.139275:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480071.139355:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526782592:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3714us (17331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480071.139366:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480071.140201:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.140421:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782720 00000100:00100000:1.0:1789480071.140429:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782720 00002000:00100000:1.0:1789480071.140494:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d22bfd8fb80 x1876405526782720/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:222/0 lens 504/0 e 0 to 0 dl 1789480082 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480071.140504:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bfd8fb80 with x1876405526782720 ext(0->12) 00002000:00010000:1.0:1789480071.140510:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bfd8fb80 00000100:00100000:1.0:1789480071.140541:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789480071.140550:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526782720:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789480071.141031:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2348:x1876405526782720:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 481us (830us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789480071.141039:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:1.0:1789480071.141046:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d22bfd8fb80 x1876405526782720/t4294967309(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:222/0 lens 504/448 e 0 to 0 dl 1789480082 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480071.141054:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bfd8fb80 with x1876405526782720 ext(0->12) 00002000:00010000:1.0:1789480071.141058:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bfd8fb80 00000100:00100000:0.0:1789480071.148152:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.148768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782848 00000100:00100000:2.0:1789480071.148778:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782848 00000100:00100000:2.0:1789480071.148845:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1789480071.148855:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+62:10539:x1876405526782848:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789480071.258639:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+62:10539:x1876405526782848:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 109774us (110485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.258653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000001:00080000:1.0:1789480071.258892:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967391 is committed 00000001:00080000:1.0:1789480071.258924:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:1.0:1789480071.258957:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1789480071.258992:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1789480071.258997:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789480071.259036:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d229c7b8e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789480071.259040:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bb2eda00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d229c7b83c0 00000020:00080000:1.0:1789480071.259043:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bb2ed400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bac27400 00000001:00080000:1.0:1789480071.259051:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789480071.259064:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789480071.259081:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d229c7b8900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789480071.259084:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a4a07100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d229c7b8f00 00000020:00080000:1.0:1789480071.259086:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a4a07500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bab79400 00000004:00080000:1.0:1789480071.259095:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789480071.259228:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789480071.259446:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789480071.259858:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551963776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789480071.259972:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551963648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789480071.260060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480071.260237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480071.260333:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551963648 00000100:00100000:1.0:1789480071.260341:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551963648 00000100:00100000:1.0:1789480071.260404:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551963776 00000100:00100000:1.0:1789480071.260408:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551963776 00000100:00100000:1.0:1789480071.260433:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480071.260442:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551963648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789480071.260479:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1789480071.260505:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.260525:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 9 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.260534:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1789480071.260539:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480071.260544:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.260580:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 9 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.260597:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 9 pid: 8279 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.260609:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876405551963904:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480071.260667:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34e40 going to sleep for 11 seconds 00000100:00080000:0.0:1789480071.260828:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480071.260974:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789480071.260986:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551963776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789480071.261140:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789480071.261144:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789480071 00002000:00010000:2.0:1789480071.261147:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789480071.261149:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789480071 -> 1789480071 00002000:00010000:2.0:1789480071.261151:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789480071.261206:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876405551963776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (968us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789480071.261213:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789480071.261336:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22a48af480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789480071.261344:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551963776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789480071.261721:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789480071.262059:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480071.262222:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.262314:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526782976 00000100:00100000:2.0:1789480071.262321:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526782976 00000100:00100000:2.0:1789480071.262365:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789480071.262374:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2347:x1876405526782976:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789480071.264951:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551964032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789480071.265042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480071.267110:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789480071.267125:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789480071.267409:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551964032 00000100:00100000:2.0:1789480071.267421:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551964032 00000100:00100000:1.0:1789480071.267650:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789480071.267661:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551964032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789480071.267693:0:12025:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789480071.267733:0:12025:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94c85, atime: 0x6aa94c85, ctime: 0x6aa94c85, blocks: 0x1 00010000:00010000:1.0:1789480071.267741:0:12025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.267758:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789480071.267762:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480071.267769:0:12025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.267788:0:12025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.267811:0:12025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.267819:0:12025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.267847:0:12025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789480071.268461:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3300:x1876405551964032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 800us (3417us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789480071.268483:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:1.0:1789480071.268535:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22a4977100/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789480071.268542:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551964032:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789480071.268743:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789480071.268799:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480071.268807:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.268818:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480071.268822:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.268831:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.268860:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.268940:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fdd21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.268962:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480071.268964:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480071.268966:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480071.285393:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876405551963904:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480071.285429:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.285608:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480071.285673:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526783104 00000100:00100000:0.0:1789480071.285681:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526783104 00010000:00010000:0.0:1789480071.285720:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 11 pid: 8279 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480071.285764:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1789480071.285775:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2348:x1876405526783104:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480071.285801:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480071.285809:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 11 pid: 8279 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.285824:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 11 pid: 8279 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.285847:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037fdadc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f32ab expref: 11 pid: 8279 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.285863:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480071.285948:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480071.285955:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.285967:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.285995:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480071.286045:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2348:x1876405526783104:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 272us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.286053:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00010000:00010000:0.0:1789480071.286077:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.286087:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.286104:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.286112:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.286129:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789480071.287334:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551963648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26890us (27269us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789480071.287344:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1789480071.288330:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22a48ac700/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789480071.288340:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551963648:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789480071.288595:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480071.288604:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.288616:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480071.288621:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.288632:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.288654:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.288661:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed71e0a/0xbb972366037fdd1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.288702:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480071.288704:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480071.288706:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480071.307671:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526782976:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 45288us (45442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.307685:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000001:00080000:0.0:1789480071.309128:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789480071.309154:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789480071.309166:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1789480071.312745:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480071.312863:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526783360 00000100:00100000:0.0:1789480071.312895:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526783360 00000100:00100000:0.0:1789480071.312960:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1789480071.312971:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+15:10539:x1876405526783360:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480071.313027:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480071.313054:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdd05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f333e expref: 15 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.313074:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:0.0:1789480071.313079:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480071.313128:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.313163:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.313172:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480071.313478:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f88a307 reply state 00000000c305a23e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480071.313487:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480071.313599:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+16:10539:x1876405526783360:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 628us (863us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789480071.313607:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:1.0:1789480071.317699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.318424:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526783488 00000100:00100000:2.0:1789480071.318435:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526783488 00000100:00100000:2.0:1789480071.318485:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789480071.318494:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526783488:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789480071.318712:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789480071.318716:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789480071 -> 1789480070 00002000:00010000:2.0:1789480071.318719:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789480069 00002000:00010000:2.0:1789480071.318721:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789480071 -> 1789480070 00002000:00010000:2.0:1789480071.318724:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789480071.318791:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2345:x1876405526783488:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 298us (1101us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789480071.318798:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:3.0:1789480071.319142:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319153:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319178:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319184:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480071.319188:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319196:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319212:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:3.0:1789480071.319215:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.319219:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.319226:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdd28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.329890:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.333363:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526783744 00000100:00100000:1.0:1789480071.333382:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526783744 00000100:00100000:1.0:1789480071.333456:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:1.0:1789480071.333482:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+15:10539:x1876405526783744:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789480071.333555:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.333574:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 15 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.333593:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.333635:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 15 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.333651:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 15 pid: 11710 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.333664:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba949880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551964160:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480071.333774:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98000 going to sleep for 11 seconds 00000100:00100000:1.0:1789480071.340455:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.340578:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba949880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551964160:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480071.340625:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.340631:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526783872 00000100:00100000:2.0:1789480071.340646:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526783872 00010000:00010000:2.0:1789480071.340696:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 16 pid: 11710 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.340737:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789480071.340747:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+16:2347:x1876405526783872:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480071.340778:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480071.340787:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 16 pid: 11710 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340803:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 16 pid: 11710 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340825:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3330 expref: 16 pid: 11710 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340842:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:2.0:1789480071.340847:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340858:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340878:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.340918:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480071.340966:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.340977:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.340988:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+15:2347:x1876405526783872:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 240us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.340997:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:3.0:1789480071.341025:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341049:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341057:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341064:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480071.341069:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341077:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341094:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:3.0:1789480071.341097:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789480071.341103:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.341109:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fdd2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.341195:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10539:x1876405526783744:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 7713us (11334us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789480071.341205:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:2.0:1789480071.346056:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.347139:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784000 00000100:00100000:3.0:1789480071.347154:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784000 00000100:00100000:3.0:1789480071.347241:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789480071.347256:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526784000:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789480071.348046:0:8279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.348079:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.348088:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480071.348093:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480071.348098:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.348146:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.348165:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 7 pid: 6685 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480071.348195:0:8279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8279:1876405551964288:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480071.348306:0:8279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185c2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480071.354269:0:8279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8279:1876405551964288:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480071.354351:0:8279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.357536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.358007:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784128 00000100:00100000:1.0:1789480071.358019:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784128 00010000:00010000:1.0:1789480071.358075:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.358127:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1789480071.358139:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526784128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480071.358160:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480071.358212:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.358234:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.358265:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fdd13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f334c expref: 8 pid: 6685 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.358351:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480071.358357:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480071.358365:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.358376:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.358417:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480071.358504:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526784128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 366us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480071.358512:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00010000:00010000:3.0:1789480071.358726:0:8279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358745:0:8279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358777:0:8279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358786:0:8279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358795:0:8279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358803:0:8279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480071.358808:0:8279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358819:0:8279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358833:0:8279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.358841:0:8279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003aa4aec/0xbb972366037fdd36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480071.358923:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526784000:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 11671us (12883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.358932:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1789480071.363191:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.363403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784384 00000100:00100000:2.0:1789480071.363415:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784384 00000100:00100000:2.0:1789480071.363507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:2.0:1789480071.363905:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10539:x1876405526784384:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789480071.364028:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364052:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364067:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364414:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364428:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364438:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364496:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.364526:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 15 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.365112:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551964416:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480071.365227:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480071.369277:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551964416:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480071.369336:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.371861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.371992:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784512 00000100:00100000:2.0:1789480071.372005:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784512 00010000:00010000:2.0:1789480071.372062:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 16 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.372129:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1789480071.372140:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+16:2347:x1876405526784512:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480071.372161:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480071.372169:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 16 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372184:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 16 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372225:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdcf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3337 expref: 16 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372245:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:2.0:1789480071.372251:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372261:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372269:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.372353:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480071.372421:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+15:2347:x1876405526784512:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 283us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.372429:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:3.0:1789480071.372801:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.372813:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480071.373090:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789480071.373315:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789480071.373371:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789480071.373482:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876405551964544:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789480071.373751:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480071.373795:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480071.374089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551964544 00000100:00100000:0.0:1789480071.374097:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551964544 00000100:00100000:0.0:1789480071.374158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480071.374168:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876405551964544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789480071.374318:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876405551964544:12345-0@lo:1000:mdt00_001.0 Request processed in 151us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.374326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480071.376778:0:5831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789480071.376796:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22a48af480, transno 4294967310 00000100:00100000:3.0:1789480071.376826:0:5831:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d22a48ac700 x1876405551963648/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789480087 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480071.376841:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876405551964544:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789480071.381145:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789480071.381734:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876405551964672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789480071.381829:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480071.381961:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98240 going to sleep for 11 seconds 00000100:00100000:0.0:1789480071.382105:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551964672 00000100:00100000:0.0:1789480071.382116:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551964672 00000100:00100000:0.0:1789480071.382237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480071.382249:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876405551964672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789480071.382790:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5831:x1876405551964672:12345-0@lo:1000:mdt00_001.0 Request processed in 542us (959us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789480071.382799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480071.382900:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876405551964672:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789480071.382975:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.382989:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.382999:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383005:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.383011:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383020:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383040:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d22abedfa00) 00010000:00010000:2.0:1789480071.383044:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480071.383049:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383056:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdd44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383095:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383102:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383108:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383124:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.383128:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383134:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383143:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480071.383145:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480071.383154:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383166:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.383215:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.383232:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551964800:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789480071.383345:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789480071.388000:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.388238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784640 00000100:00100000:3.0:1789480071.388251:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784640 00000100:00100000:3.0:1789480071.388375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789480071.388388:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+19:10538:x1876405526784640:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:3.0:1789480071.388586:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+19:10538:x1876405526784640:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 201us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.388595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1789480071.389065:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551964800:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789480071.389102:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389131:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fdc87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389171:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389189:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389201:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389213:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389219:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389226:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389231:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.389235:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389242:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389255:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480071.389258:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480071.389262:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389313:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389319:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389326:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389331:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.389334:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389340:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389347:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480071.389350:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480071.389353:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.389357:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fdd3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.389869:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10539:x1876405526784384:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 25965us (26690us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789480071.389888:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000020:00080000:2.0:1789480071.389903:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789480071.390513:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480071.390823:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480071.391796:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789480071.391814:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789480071.395999:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480071.396165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526784896 00000100:00100000:3.0:1789480071.396180:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526784896 00000100:00100000:3.0:1789480071.396274:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1789480071.396332:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10538:x1876405526784896:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:3.0:1789480071.397388:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789480071.399826:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10538:x1876405526784896:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 3479us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.399848:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:2.0:1789480071.400178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480071.411574:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526785152 00000100:00100000:0.0:1789480071.411626:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526785152 00000100:00100000:2.0:1789480071.411966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789480071.411982:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+18:10539:x1876405526785152:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789480071.412897:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789480071.413036:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789480071.413098:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413121:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413136:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413146:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413153:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413159:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.413182:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480071.413372:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10539:x1876405526785152:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1389us (13190us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789480071.413381:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000020:00080000:2.0:1789480071.413388:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480071.417941:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480071.417962:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.417978:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480071.417984:0:11176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.417998:0:11176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.418022:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d228804d300) 00010000:00010000:3.0:1789480071.418026:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480071.418032:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.418067:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fdd52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.418096:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480071.418098:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480071.418100:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480071.428861:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480071.429100:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526785280 00000100:00100000:1.0:1789480071.429114:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526785280 00000100:00100000:1.0:1789480071.429192:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1789480071.429204:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+20:10541:x1876405526785280:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480071.429249:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480071.429274:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdd59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3353 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.429984:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430003:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430017:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430034:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430041:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430047:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430375:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430388:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430405:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430448:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480071.430467:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 21 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480071.430483:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551964928:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480071.431006:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480071.434931:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480071.435016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526785536 00000100:00100000:2.0:1789480071.435030:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526785536 00000100:00100000:2.0:1789480071.435130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789480071.435141:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+22:5588:x1876405526785536:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789480071.435821:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:5588:x1876405526785536:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 680us (904us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789480071.435831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480071.436155:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551964928:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480071.436192:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480071.438433:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480071.438602:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526785664 00000100:00100000:0.0:1789480071.438614:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526785664 00010000:00010000:0.0:1789480071.438672:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 23 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480071.438729:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789480071.438743:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+23:2348:x1876405526785664:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480071.438776:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480071.438784:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 23 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438802:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 23 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438835:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdc79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3314 expref: 23 pid: 5832 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438860:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480071.438865:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438888:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438898:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.438947:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480071.439046:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+22:2348:x1876405526785664:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 305us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.439055:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00010000:00010000:2.0:1789480071.439169:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439180:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480071.439401:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789480071.439407:0:11710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480071.439434:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439449:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439460:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439468:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439475:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439482:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.439487:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.439505:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440767:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:2.0:1789480071.440776:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480071.440786:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440795:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdd60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440823:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440830:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440836:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.440843:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480071.440846:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441188:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441202:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d22abedf300) 00010000:00010000:2.0:1789480071.441205:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480071.441618:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441650:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441723:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdd59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3353 expref: 22 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441741:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3353 expref: 21 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480071.441748:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:2.0:1789480071.441750:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480071.441753:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147600, rc 0) 00000100:00100000:2.0:1789480071.442665:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+21:10541:x1876405526785280:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 12649us (13005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.442678:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1789480072.031976:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551965056:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032079:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032140:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551965568:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032201:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789480072.032208:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551965184:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032253:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551965696:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032328:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551965312:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032356:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032376:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480072.032380:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551965440:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480072.032431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965056 00000100:00100000:3.0:1789480072.032440:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965056 00000100:00100000:3.0:1789480072.032513:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789480072.032523:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551965056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032717:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551965056:12345-0@lo:400:kworker.0 Request processed in 194us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.032725:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789480072.032762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965568 00000100:00100000:3.0:1789480072.032766:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965568 00000100:00100000:3.0:1789480072.032808:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965184 00000100:00100000:3.0:1789480072.032811:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965184 00000100:00100000:3.0:1789480072.032828:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965312 00000100:00100000:3.0:1789480072.032831:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965312 00000100:00100000:3.0:1789480072.032848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789480072.032854:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551965568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032902:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551965568:12345-0@lo:400:kworker.0 Request processed in 47us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.032909:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789480072.032921:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789480072.032927:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551965184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.032956:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551965184:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.032961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789480072.032972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789480072.032977:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.033025:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551965312:12345-0@lo:400:kworker.0 Request processed in 47us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.033031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1789480072.033056:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480072.033099:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551965312:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.033142:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551965184:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.033152:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551965056:0@lo:400:kworker.0 00000100:00100000:3.0:1789480072.033161:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551965568:0@lo:400:kworker.0 00000100:00100000:2.0:1789480072.033851:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965696 00000100:00100000:2.0:1789480072.033860:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965696 00000100:00100000:2.0:1789480072.033930:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965440 00000100:00100000:2.0:1789480072.033934:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965440 00000100:00100000:2.0:1789480072.033965:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789480072.033973:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876405551965696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480072.034050:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876405551965696:12345-0@lo:400:kworker.0 Request processed in 77us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480072.034057:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789480072.034075:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789480072.034081:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876405551965440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480072.034137:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876405551965440:12345-0@lo:400:kworker.0 Request processed in 56us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480072.034144:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789480072.034199:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551965440:0@lo:400:kworker.0 00000100:00100000:2.0:1789480072.034236:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551965696:0@lo:400:kworker.0 00010000:00010000:2.0:1789480072.284587:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480072.410790:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480072.410803:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480072.410872:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789480072.410883:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480072.411064:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551965824:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789480072.411188:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480072.415054:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480072.415093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526785792 00000100:00100000:3.0:1789480072.415103:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526785792 00000100:00100000:3.0:1789480072.415180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:3.0:1789480072.415190:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10552:x1876405526785792:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480072.415236:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480072.415520:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551965824:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1789480072.415723:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480072.416682:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+21:10552:x1876405526785792:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 1485us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.416696:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:0.0:1789480072.424516:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480072.424669:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526786048 00000100:00100000:1.0:1789480072.424685:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526786048 00000100:00100000:1.0:1789480072.424776:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1789480072.424791:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+21:10552:x1876405526786048:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480072.424820:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480072.424845:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdd75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f335a expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.424998:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.425041:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.425055:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480072.425070:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789480072.425234:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdd75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f335a expref: 24 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.425256:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f335a expref: 23 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.425267:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480072.425270:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480072.425275:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146600, rc 0) 00000100:00100000:1.0:1789480072.425379:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+23:10552:x1876405526786048:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 591us (887us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789480072.425388:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:2.0:1789480072.446136:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480072.446201:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480072.446844:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526786432 00000100:00100000:1.0:1789480072.446869:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526786432 00000100:00100000:1.0:1789480072.446954:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1789480072.446967:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+23:2348:x1876405526786432:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480072.446989:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480072.447024:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdd7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f335a expref: 23 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480072.447073:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:1.0:1789480072.447080:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480072.447156:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+22:2348:x1876405526786432:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 191us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480072.447164:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789480072.447727:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526786304 00000100:00100000:3.0:1789480072.447736:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526786304 00000100:00100000:3.0:1789480072.451361:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:3.0:1789480072.451397:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+22:10552:x1876405526786304:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789480072.451523:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451571:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451586:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451828:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451836:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451844:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451851:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480072.451855:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451877:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451892:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480072.451895:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480072.451901:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.451908:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480072.452139:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+23:10552:x1876405526786304:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 759us (6016us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789480072.452159:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000040:00080000:0.0:1789480072.453887:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480072.453898:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480072.454744:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789480072.454757:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480072.460923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480072.461048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526786688 00000100:00100000:0.0:1789480072.461061:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526786688 00000100:00100000:0.0:1789480072.461139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1789480072.461152:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+23:10552:x1876405526786688:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480072.461637:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:10552:x1876405526786688:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 485us (730us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789480072.461646:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000040:00080000:2.0:1789480072.669215:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480072.669230:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480072.669322:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789480072.669331:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480072.884815:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480072.885177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526786944 00000100:00100000:3.0:1789480072.885191:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526786944 00000100:00100000:3.0:1789480072.885514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1789480072.885652:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+24:10566:x1876405526786944:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480072.885692:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480072.885722:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3361 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.885875:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fdd98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.885893:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fdd98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.885908:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fdd98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480072.885922:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789480072.886095:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4800/0xbb972366037fdd91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3361 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.886119:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fdd98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3361 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480072.886128:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480072.886130:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480072.886152:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4e00, rc 0) 00000100:00100000:3.0:1789480072.886251:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+26:10566:x1876405526786944:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 724us (1456us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789480072.886259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:0.0:1789480072.894337:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480072.894404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787072 00000100:00100000:0.0:1789480072.894416:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787072 00000100:00100000:0.0:1789480072.894497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:0.0:1789480072.894510:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:10566:x1876405526787072:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789480072.894624:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894648:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894682:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894718:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894727:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894734:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894741:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480072.894747:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894756:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894769:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:0.0:1789480072.894772:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480072.894778:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480072.894784:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdda6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480072.894887:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:10566:x1876405526787072:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 379us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480072.894895:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:1.0:1789480073.017439:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480073.017488:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787200 00000100:00100000:3.0:1789480073.017503:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787200 00000100:00080000:1.0:1789480073.017554:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480073.017590:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1789480073.017604:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526787200:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789480073.017632:0:8279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480073.017664:0:8279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fddad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3368 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480073.017703:0:8279:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94c86, atime: 0x6aa94c85, ctime: 0x6aa94c86, blocks: 0xb 00010000:00010000:3.0:1789480073.017745:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1789480073.017751:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480073.017764:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fddad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3368 expref: 7 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.017791:0:8279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fddad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3368 expref: 7 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.017809:0:8279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789480073.017894:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2345:x1876405526787200:12345-192.168.204.54@tcp:101:cat.0 Request processed in 293us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.020417:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789480073.023922:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480073.024119:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787328 00000100:00100000:3.0:1789480073.024149:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787328 00002000:00100000:3.0:1789480073.024219:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d22a485c000 x1876405526787328/t0(0) o3->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:224/0 lens 488/0 e 0 to 0 dl 1789480084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480073.024335:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22a485c000 with x1876405526787328 ext(0->4095) 00002000:00010000:3.0:1789480073.024343:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22a485c000 00000100:00100000:3.0:1789480073.024386:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480073.024400:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526787328:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:3.0:1789480073.024735:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526787328:12345-192.168.204.54@tcp:3:cat.0 Request processed in 338us (828us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789480073.024744:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00100000:3.0:1789480073.024752:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d22a485c000 x1876405526787328/t0(0) o3->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:224/0 lens 488/4536 e 0 to 0 dl 1789480084 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480073.024759:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22a485c000 with x1876405526787328 ext(0->4095) 00002000:00010000:3.0:1789480073.024763:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22a485c000 00000100:00100000:3.0:1789480073.071541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480073.071605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480073.071674:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787456 00000100:00100000:0.0:1789480073.071706:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787456 00000100:00100000:0.0:1789480073.071781:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:0.0:1789480073.071795:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2345:x1876405526787456:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480073.071922:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2345:x1876405526787456:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 131us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480073.071932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 295 00000100:00100000:2.0:1789480073.072081:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787584 00000100:00100000:2.0:1789480073.072088:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787584 00000100:00100000:2.0:1789480073.072147:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:2.0:1789480073.072169:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+26:2345:x1876405526787584:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480073.072236:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+26:2345:x1876405526787584:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 69us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480073.072243:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:3.0:1789480073.076359:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480073.076409:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480073.076451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480073.076571:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787968 00000100:00100000:1.0:1789480073.076586:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787968 00000100:00100000:1.0:1789480073.076683:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:1.0:1789480073.076698:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526787968:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480073.076818:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526787968:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 125us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.076826:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:0.0:1789480073.077181:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787840 00000100:00100000:0.0:1789480073.077187:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787840 00000100:00100000:0.0:1789480073.077240:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526787712 00000100:00100000:0.0:1789480073.077244:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526787712 00000100:00100000:0.0:1789480073.077273:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1789480073.077317:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526787840:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480073.077366:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526787840:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 85us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480073.077373:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1789480073.077391:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1789480073.077399:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526787712:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480073.077429:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526787712:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480073.077436:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00080000:3.0:1789480073.077907:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480073.077927:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480073.306944:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789480074.165578:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789480074.165711:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789480074.165823:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1789480074.338187:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480074.589730:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551965952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480074.589841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480074.589956:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551965952 00000100:00100000:1.0:1789480074.589967:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551965952 00000100:00100000:1.0:1789480074.590048:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789480074.590060:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551965952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480074.590108:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789480074.594906:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480074.597225:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551965952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7149us (7365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.597248:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789480074.599487:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789480074.599512:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789480074.599546:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22a4977100, transno 4294967304 00000100:00100000:2.0:1789480074.600081:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551965952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480075.098881:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551966080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480075.098985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480075.099122:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966080 00000100:00100000:1.0:1789480075.099137:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966080 00000100:00100000:1.0:1789480075.099320:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789480075.099340:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551966080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480075.100732:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480075.100865:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551966080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1529us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480075.100879:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789480075.100932:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480075.101009:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551966080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789480075.359151:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480076.380213:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480076.570758:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480076.570771:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480076.571279:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789480076.571335:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789480076.756545:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1789480076.756564:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789480076.756614:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1789480076.756628:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d22a4a340c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789480076.756640:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a4a07600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22a4a34cc0 00000020:00080000:0.0:1789480076.756644:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22a4a07400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d21854db000 00000020:00080000:0.0:1789480076.756664:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789480076.756881:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789480076.798121:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789480076.798139:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1789480077.153528:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551966208:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.153634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.153706:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551966720:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.153737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.153781:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480077.153788:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551966336:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.153813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.153840:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551966848:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.153872:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.153916:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551966464:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.153944:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.153971:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480077.153978:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551966592:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154004:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480077.154043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966208 00000100:00100000:2.0:1789480077.154052:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966208 00000100:00100000:2.0:1789480077.154111:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789480077.154121:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551966208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154187:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551966208:12345-0@lo:400:kworker.0 Request processed in 66us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154213:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789480077.154264:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966720 00000100:00100000:2.0:1789480077.154269:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966720 00000100:00100000:2.0:1789480077.154357:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966336 00000100:00100000:2.0:1789480077.154362:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966336 00000100:00100000:2.0:1789480077.154389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966464 00000100:00100000:2.0:1789480077.154393:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966464 00000100:00100000:2.0:1789480077.154417:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480077.154424:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551966720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154477:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551966720:12345-0@lo:400:kworker.0 Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480077.154514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789480077.154523:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551966336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154568:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551966336:12345-0@lo:400:kworker.0 Request processed in 47us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789480077.154602:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789480077.154611:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551966464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154659:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551966464:12345-0@lo:400:kworker.0 Request processed in 50us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789480077.154701:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966848 00000100:00100000:2.0:1789480077.154706:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966848 00000100:00100000:2.0:1789480077.154741:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966592 00000100:00100000:2.0:1789480077.154744:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966592 00000100:00100000:2.0:1789480077.154782:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789480077.154798:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551966848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154834:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551966848:12345-0@lo:400:kworker.0 Request processed in 38us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154841:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789480077.154853:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789480077.154859:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551966592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.154887:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551966592:12345-0@lo:400:kworker.0 Request processed in 28us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.154893:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789480077.154925:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480077.154929:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480077.154932:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480077.154978:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789480077.154985:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22a48ac700, transno 4294967311 00000004:00080000:2.0:1789480077.154997:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789480077.155026:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551966592:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.155041:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551966464:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.155544:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551966336:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.155557:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551966848:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.155567:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551966208:0@lo:400:kworker.0 00000100:00100000:2.0:1789480077.155578:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551966720:0@lo:400:kworker.0 00010000:00010000:3.0:1789480077.402638:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480078.202887:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480078.202942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480078.203028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480078.203054:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480078.203080:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480078.203967:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788096 00000100:00100000:3.0:1789480078.203984:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788096 00000100:00100000:3.0:1789480078.204060:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:3.0:1789480078.204073:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526788096:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480078.204169:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526788096:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 99us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.204179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 297 00000100:00100000:1.0:1789480078.211315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788608 00000100:00100000:1.0:1789480078.211663:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788608 00000100:00100000:1.0:1789480078.211764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788224 00000100:00100000:1.0:1789480078.211768:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788224 00000100:00100000:1.0:1789480078.211818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:1.0:1789480078.211833:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526788608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480078.211951:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526788608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 122us (8923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.211961:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:1.0:1789480078.211984:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1789480078.211992:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2348:x1876405526788224:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480078.212038:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2348:x1876405526788224:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (8982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.212045:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00080000:1.0:1789480078.212070:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480078.214489:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788352 00000100:00100000:0.0:1789480078.214510:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788352 00000100:00100000:0.0:1789480078.214625:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788480 00000100:00100000:0.0:1789480078.214629:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788480 00000100:00100000:0.0:1789480078.214661:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789480078.214673:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526788352:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480078.214792:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526788352:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 121us (11849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.214801:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1789480078.214941:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789480078.214950:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526788480:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480078.214980:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526788480:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (11899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.214987:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00080000:2.0:1789480078.215203:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480078.215221:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789480078.433432:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480079.060555:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480079.060672:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788736 00000100:00100000:2.0:1789480079.060703:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788736 00000100:00100000:2.0:1789480079.060790:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:2.0:1789480079.060802:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10226:x1876405526788736:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789480079.060956:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10226:x1876405526788736:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 156us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480079.060965:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:2.0:1789480079.071379:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480079.071479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526788992 00000100:00100000:3.0:1789480079.071497:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526788992 00000100:00100000:3.0:1789480079.071571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789480079.071583:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:10226:x1876405526788992:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480079.072052:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+14:10226:x1876405526788992:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 469us (687us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789480079.072060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00010000:00010000:1.0:1789480079.461756:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480079.706986:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480079.707033:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551966976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480079.707131:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.707577:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551966976 00000100:00100000:0.0:1789480079.707588:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551966976 00000100:00100000:0.0:1789480079.707681:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789480079.707694:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551966976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480079.707756:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480079.707949:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551966976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 258us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.707974:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789480079.708134:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551966976:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789480079.708275:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480080.220320:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551967104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480080.220423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480080.220666:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967104 00000100:00100000:0.0:1789480080.220677:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967104 00000100:00100000:0.0:1789480080.220767:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789480080.220779:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551967104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480080.220828:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480080.220885:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551967104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480080.220893:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789480080.221047:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480080.221095:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551967104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480080.479157:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480081.032817:0:12264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:47:59 (1789480079) 00010000:00010000:0.0:1789480081.498630:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789480081.822532:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1789480081.822586:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789480081.822702:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789480081.822722:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789480082.270626:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551967232:0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.270744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480082.270815:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551967744:0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.270848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480082.270880:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480082.270887:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551967360:0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.270911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480082.270943:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551967872:0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.270971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480082.271016:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967872 00000100:00100000:2.0:1789480082.271025:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967872 00000100:00100000:2.0:1789480082.271098:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789480082.271109:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551967872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.271171:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551967872:12345-0@lo:400:kworker.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.271180:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789480082.271263:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551967872:0@lo:400:kworker.0 00000100:00100000:3.0:1789480082.271642:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551967616:0@lo:400:kworker.0 00000100:00100000:3.0:1789480082.271693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480082.271750:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480082.271758:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551967488:0@lo:400:kworker.0 00000100:00100000:3.0:1789480082.271784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789480082.271812:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480082.272234:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967232 00000100:00100000:1.0:1789480082.272243:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967232 00000100:00100000:1.0:1789480082.272355:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789480082.272365:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551967232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480082.272429:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551967232:12345-0@lo:400:kworker.0 Request processed in 65us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480082.272436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789480082.272479:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967744 00000100:00100000:1.0:1789480082.272484:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967744 00000100:00100000:1.0:1789480082.272516:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967360 00000100:00100000:1.0:1789480082.272520:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967360 00000100:00100000:1.0:1789480082.272539:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967488 00000100:00100000:1.0:1789480082.272541:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967488 00000100:00100000:1.0:1789480082.272558:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789480082.272565:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551967744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480082.272600:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551967744:12345-0@lo:400:kworker.0 Request processed in 35us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480082.272616:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789480082.272629:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789480082.272635:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551967360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480082.272666:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551967360:12345-0@lo:400:kworker.0 Request processed in 30us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480082.272683:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789480082.272704:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789480082.272710:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551967488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480082.272744:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551967488:12345-0@lo:400:kworker.0 Request processed in 34us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480082.272750:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1789480082.273068:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480082.273109:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551967488:0@lo:400:kworker.0 00000100:00100000:0.0:1789480082.273334:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551967360:0@lo:400:kworker.0 00000100:00100000:0.0:1789480082.273356:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22baec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551967232:0@lo:400:kworker.0 00000100:00100000:0.0:1789480082.273368:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551967744:0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.274054:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551967616 00000100:00100000:2.0:1789480082.274081:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551967616 00000100:00100000:2.0:1789480082.274165:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789480082.274177:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551967616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480082.274330:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551967616:12345-0@lo:400:kworker.0 Request processed in 157us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.274338:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789480082.274609:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480082.275592:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551967616:0@lo:400:kworker.0 00010000:00010000:1.0:1789480082.522678:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480082.765069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480082.765435:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789248 00000100:00100000:1.0:1789480082.765449:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789248 00000100:00100000:1.0:1789480082.765618:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:1.0:1789480082.765634:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+13:11276:x1876405526789248:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480082.765676:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480082.765704:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fddb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f336f expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480082.765827:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480082.765845:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480082.765885:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789480082.767518:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480082.769508:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480082.769532:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480082.769545:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.774535:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fddc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.774563:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fddc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.774577:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fddc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480082.774590:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789480082.775256:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775312:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775321:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775328:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480082.775334:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775342:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775355:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d228804db00) 00010000:00010000:0.0:1789480082.775358:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480082.775363:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775370:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fddbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775385:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775391:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775397:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775402:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480082.775413:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775420:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775427:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d22abedfd00) 00010000:00010000:0.0:1789480082.775430:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480082.775434:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.775440:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fddc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.776448:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fddb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f336f expref: 16 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.776475:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fddc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f336f expref: 15 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.776482:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480082.776485:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480082.776488:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:0.0:1789480082.776576:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11276:x1876405526789248:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 10946us (11522us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789480082.776585:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:1.0:1789480082.783840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480082.783927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480082.784033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789504 00000100:00100000:2.0:1789480082.784044:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789504 00000100:00100000:2.0:1789480082.784138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:2.0:1789480082.784151:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11276:x1876405526789504:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789480082.784270:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11276:x1876405526789504:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.784278:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1789480082.784358:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789376 00000100:00100000:0.0:1789480082.784363:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789376 00000100:00100000:0.0:1789480082.784402:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789480082.784409:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+15:2346:x1876405526789376:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480082.784437:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480082.784463:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fddc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f336f expref: 15 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480082.784482:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480082.784488:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480082.784510:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2346:x1876405526789376:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 102us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480082.784516:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480083.311130:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480083.311210:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789632 00000100:00100000:3.0:1789480083.311224:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789632 00000100:00100000:3.0:1789480083.311676:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:3.0:1789480083.311689:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526789632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480083.311793:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2347:x1876405526789632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 106us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480083.311801:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 299 00000100:00100000:0.0:1789480083.325410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480083.325457:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480083.325481:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480083.325512:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480083.325556:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790016 00000100:00100000:0.0:1789480083.325569:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790016 00000100:00100000:0.0:1789480083.325644:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789888 00000100:00100000:0.0:1789480083.325658:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789888 00000100:00100000:0.0:1789480083.325690:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1789480083.325703:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526790016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480083.325800:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2345:x1876405526790016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480083.325810:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1789480083.325834:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789480083.325841:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526789888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480083.325870:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526789888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480083.325896:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1789480083.325920:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526789760 00000100:00100000:0.0:1789480083.325924:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526789760 00000100:00100000:0.0:1789480083.325953:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790144 00000100:00100000:0.0:1789480083.325955:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790144 00000100:00100000:0.0:1789480083.325983:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1789480083.325990:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2345:x1876405526789760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480083.326022:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2345:x1876405526789760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480083.326028:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1789480083.326040:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:0.0:1789480083.326046:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526790144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480083.326070:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2345:x1876405526790144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480083.326076:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00080000:0.0:1789480083.326095:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480083.326101:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480083.326103:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789480083.548880:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480083.745467:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480083.745481:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480083.745974:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789480083.745986:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789480084.570463:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480084.828547:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480084.828581:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551968000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480084.828701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480084.828933:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551968000 00000100:00100000:0.0:1789480084.828955:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551968000 00000100:00100000:0.0:1789480084.829046:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789480084.829058:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551968000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480084.829111:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480084.829176:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551968000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.829367:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789480084.829433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551968000:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789480084.829516:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480085.249852:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480085.249971:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790272 00000100:00100000:1.0:1789480085.249984:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790272 00000100:00100000:1.0:1789480085.250080:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1789480085.250097:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:11319:x1876405526790272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480085.250124:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480085.250151:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fddd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3376 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250236:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250269:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250318:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250339:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250347:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250354:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250600:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250608:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250628:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250634:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.250639:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250646:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:1.0:1789480085.250669:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.250676:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250683:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fddde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250696:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250702:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250707:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250712:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.250714:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250720:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250726:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d22abedf300) 00010000:00010000:1.0:1789480085.250728:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.250731:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250736:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdde5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250784:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fddd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3376 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250805:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:1.0:1789480085.250808:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.250812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fddd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3376 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.250821:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147000, rc 0) 00000100:00100000:1.0:1789480085.250909:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:11319:x1876405526790272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 816us (1070us total) trans 0 rc 301/301 00000100:00100000:1.0:1789480085.250917:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00080000:0.0:1789480085.251854:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480085.266262:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.266341:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790528 00000100:00100000:2.0:1789480085.266355:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790528 00000100:00100000:2.0:1789480085.266485:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:2.0:1789480085.266497:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+14:11319:x1876405526790528:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1789480085.266585:0:11710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480085.266632:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fd763 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31b6 expref: 14 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.266653:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d100) 00010000:00010000:2.0:1789480085.266668:0:11710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480085.266984:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.267011:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.267025:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.267039:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.267046:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.267051:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480085.268102:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789480085.268122:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268132:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268140:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268147:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.268153:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268161:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268187:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480085.268190:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480085.268197:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.268204:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fddec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480085.268227:0:11710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a05e6189 reply state 0000000086cf65f7 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.268237:0:11710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480085.268410:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11319:x1876405526790528:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 1910us (2153us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789480085.268420:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00010000:00010000:0.0:1789480085.271832:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271854:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271863:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271870:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480085.271876:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271885:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271906:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d228804d800) 00010000:00010000:0.0:1789480085.271909:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480085.271915:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.271922:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fddf3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.343781:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551968128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480085.343880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480085.343980:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551968128 00000100:00100000:2.0:1789480085.343991:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551968128 00000100:00100000:2.0:1789480085.344062:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789480085.344073:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551968128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480085.344119:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480085.344172:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551968128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480085.344181:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789480085.344209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480085.344692:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551968128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480085.370707:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.370953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790656 00000100:00100000:3.0:1789480085.370965:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790656 00000100:00100000:3.0:1789480085.371033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:3.0:1789480085.371048:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+14:11327:x1876405526790656:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:3.0:1789480085.371084:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480085.371115:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fddfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f337d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371246:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371263:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371278:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480085.371351:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480085.371355:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480085.371383:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371413:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fddfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f337d expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371431:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f337d expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.371440:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:3.0:1789480085.371443:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480085.371448:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4a00, rc 0) 00000100:00100000:3.0:1789480085.371974:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11327:x1876405526790656:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 928us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480085.371984:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:3.0:1789480085.456851:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.457167:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526790784 00000100:00100000:0.0:1789480085.457181:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526790784 00000100:00100000:0.0:1789480085.457335:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1789480085.457349:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+15:11333:x1876405526790784:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480085.457378:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480085.457410:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fde08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3384 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457495:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457517:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457532:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457551:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457559:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.457566:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460210:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460232:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460245:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480085.460334:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789480085.460339:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480085.460372:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460388:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460395:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460424:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460430:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.460434:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460441:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460454:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:1.0:1789480085.460457:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.460462:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460469:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6a00/0xbb972366037fde0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460488:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460493:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460499:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460503:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.460506:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460522:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460530:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2290ce3500) 00010000:00010000:1.0:1789480085.460532:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.460535:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460541:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fde16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460585:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fde08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3384 expref: 17 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460601:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3384 expref: 16 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.460623:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480085.460626:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789480085.460628:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147000, rc 0) 00000100:00100000:1.0:1789480085.460714:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+16:11333:x1876405526790784:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3367us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480085.460724:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:3.0:1789480085.470098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.470537:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791040 00000100:00100000:2.0:1789480085.470558:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791040 00000100:00100000:2.0:1789480085.470725:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1789480085.470738:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+16:11333:x1876405526791040:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480085.470772:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480085.470803:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fde24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f338b expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.470976:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.470994:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.471009:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.472374:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.472397:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.472412:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480085.473227:0:11710:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789480085.474105:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474128:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474159:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474211:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474219:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474227:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474233:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.474239:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474248:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474263:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480085.474266:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480085.474273:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474279:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fde2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480085.474319:0:11710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dd9af38 reply state 00000000bf3cf70c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.474330:0:11710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789480085.474391:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fde24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 19 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474409:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 18 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.474417:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480085.474420:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480085.474422:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480085.474654:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11333:x1876405526791040:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3917us (4571us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789480085.474663:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00010000:00010000:3.0:1789480085.477426:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477448:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477458:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477466:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480085.477472:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477482:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477503:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804d700) 00010000:00010000:3.0:1789480085.477507:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480085.477515:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.477521:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fde32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480085.478719:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.479604:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791168 00000100:00100000:0.0:1789480085.479628:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791168 00000100:00100000:0.0:1789480085.479775:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789480085.479788:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526791168:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480085.479813:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480085.479839:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480085.479894:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480085.479922:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1789480085.479927:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480085.479937:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.479959:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.479975:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7800, rc 0) 00000100:00100000:0.0:1789480085.480061:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526791168:12345-192.168.204.54@tcp:101:bash.0 Request processed in 275us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480085.480069:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00080000:2.0:1789480085.480908:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480085.484944:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.485096:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791296 00000100:00100000:0.0:1789480085.485110:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791296 00000100:00100000:0.0:1789480085.489350:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480085.489390:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+6:11333:x1876405526791296:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480085.489421:0:12025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480085.489451:0:12025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3399 expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.489504:0:12025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.489540:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480085.489545:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480085.489553:0:12025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 7 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.489617:0:12025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.489639:0:12025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480085.489658:0:12025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12025:1876405551968256:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480085.489963:0:12025:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480085.496712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.496750:0:12025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4977100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12025:1876405551968256:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480085.496796:0:12025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 7 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.496825:0:12025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6600, rc 0) 00000100:00100000:0.0:1789480085.496904:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:11333:x1876405526791296:12345-192.168.204.54@tcp:101:bash.0 Request processed in 7536us (11978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480085.496915:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1789480085.497024:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791424 00000100:00100000:1.0:1789480085.497034:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791424 00010000:00010000:1.0:1789480085.497077:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480085.497150:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1789480085.497161:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526791424:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480085.497178:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480085.497206:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.497222:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.497252:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003294e6b1/0xbb972366037fde47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3392 expref: 7 pid: 6686 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.497269:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480085.497273:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480085.497350:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.497364:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.497407:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480085.497424:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8453:1876405551968384:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480085.497501:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f513c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480085.502404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480085.502410:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8453:1876405551968384:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480085.502448:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480085.502533:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526791424:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5373us (5845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480085.502547:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1789480085.502674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791680 00000100:00100000:0.0:1789480085.502686:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791680 00000100:00100000:0.0:1789480085.502750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1789480085.502779:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11333:x1876405526791680:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1789480085.503239:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11333:x1876405526791680:12345-192.168.204.54@tcp:35:bash.0 Request processed in 459us (851us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789480085.503246:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00010000:00010000:1.0:1789480085.594616:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480085.596513:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.596684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526791936 00000100:00100000:3.0:1789480085.596697:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526791936 00000100:00100000:3.0:1789480085.596778:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:3.0:1789480085.596790:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11343:x1876405526791936:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480085.596843:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480085.596872:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fde55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480085.596995:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789480085.597156:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fde55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33a0 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.597173:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:3.0:1789480085.597176:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480085.597460:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fde55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33a0 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.597482:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480085.597634:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11343:x1876405526791936:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 846us (1134us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789480085.597643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:3.0:1789480085.603600:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.603890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526792192 00000100:00100000:0.0:1789480085.603904:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526792192 00000100:00100000:0.0:1789480085.603982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1789480085.603995:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11343:x1876405526792192:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480085.604508:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+21:11343:x1876405526792192:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 514us (922us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789480085.604518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1789480085.699912:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480085.700179:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526792320 00000100:00100000:1.0:1789480085.700195:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526792320 00000100:00100000:1.0:1789480085.700335:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:1.0:1789480085.700349:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+21:11349:x1876405526792320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480085.700388:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480085.700421:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fde63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33a7 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700534:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700554:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700570:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480085.700631:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789480085.700635:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480085.700670:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700733:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fde63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33a7 expref: 23 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700758:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33a7 expref: 22 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.700766:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480085.700769:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480085.700774:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147c00, rc 0) 00000100:00100000:1.0:1789480085.700878:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+22:11349:x1876405526792320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 533us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480085.700887:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1789480085.707592:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.708339:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526792576 00000100:00100000:0.0:1789480085.708354:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526792576 00000100:00100000:0.0:1789480085.708446:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:0.0:1789480085.708458:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+22:11349:x1876405526792576:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480085.708487:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480085.708514:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fde71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33ae expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.708664:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fde78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.708682:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fde78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.708696:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fde78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480085.708728:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789480085.708904:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fde71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ae expref: 25 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.708928:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fde78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ae expref: 24 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.708938:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:0.0:1789480085.708941:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480085.708946:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:0.0:1789480085.709165:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11349:x1876405526792576:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 708us (1589us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789480085.709173:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:3.0:1789480085.715358:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.715501:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.715585:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526792960 00000100:00100000:1.0:1789480085.715586:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526792832 00000100:00100000:2.0:1789480085.715609:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526792960 00000100:00100000:1.0:1789480085.715614:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526792832 00000100:00100000:0.0:1789480085.718190:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480085.718227:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+25:2345:x1876405526792960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480085.718253:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480085.718305:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fde78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ae expref: 25 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.718331:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:0.0:1789480085.718338:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480085.718425:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+24:2345:x1876405526792960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 219us (2922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480085.718433:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789480085.718586:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:1.0:1789480085.718598:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11349:x1876405526792832:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480085.718646:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480085.718667:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fde86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33b5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.718794:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.718812:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.718826:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480085.718861:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789480085.719029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fde86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33b5 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.719048:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33b5 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.719056:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:1.0:1789480085.719059:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480085.719063:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146600, rc 0) 00000100:00100000:1.0:1789480085.719115:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11349:x1876405526792832:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 520us (3772us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789480085.719123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:0.0:1789480085.730397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.730803:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793088 00000100:00100000:3.0:1789480085.730819:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793088 00000100:00100000:3.0:1789480085.730894:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1789480085.730907:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526793088:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:3.0:1789480085.730969:0:8279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.731009:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.731022:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480085.731028:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480085.731033:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.731084:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.731118:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 6 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480085.731140:0:8279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551968512:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480085.731277:0:8279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480085.743225:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.743585:0:8279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8279:1876405551968512:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480085.743706:0:8279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480085.743930:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793216 00000100:00100000:1.0:1789480085.743941:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793216 00002000:00100000:1.0:1789480085.744011:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d22bd69aa00 x1876405526793216/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:236/0 lens 504/0 e 0 to 0 dl 1789480096 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480085.744037:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd69aa00 with x1876405526793216 ext(0->12) 00010000:00010000:1.0:1789480085.744046:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 7 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.744067:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 7 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480085.744076:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22bd69aa00 00000100:00100000:1.0:1789480085.744117:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789480085.744149:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526793216:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:1.0:1789480085.748356:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526793216:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 4190us (5128us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789480085.748375:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:1.0:1789480085.748392:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d22bd69aa00 x1876405526793216/t4294967305(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:236/0 lens 504/448 e 0 to 0 dl 1789480096 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480085.751534:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd69aa00 with x1876405526793216 ext(0->12) 00010000:00010000:1.0:1789480085.751562:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.751591:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480085.751614:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22bd69aa00 00000100:00100000:2.0:1789480085.755092:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.755351:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793344 00000100:00100000:0.0:1789480085.755386:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793344 00010000:00010000:0.0:1789480085.755444:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480085.755500:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1789480085.755514:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526793344:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480085.755536:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789480085.755564:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789480085.755568:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789480085 00002000:00010000:0.0:1789480085.755570:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789480086 00002000:00010000:0.0:1789480085.755572:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789480085 00010000:00010000:0.0:1789480085.755580:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.755611:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.755763:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8acb738/0xbb972366037fde4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3399 expref: 9 pid: 12025 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.755786:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480085.755791:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480085.755799:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.755839:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480085.755885:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480085.755973:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526793344:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 461us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480085.755981:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00010000:00010000:3.0:1789480085.756080:0:8279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756093:0:8279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756136:0:8279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756145:0:8279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756155:0:8279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756163:0:8279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480085.756168:0:8279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756178:0:8279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756194:0:8279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.756201:0:8279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080c7ff81/0xbb972366037fde9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480085.756955:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526793088:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 26045us (26575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480085.756967:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480085.760138:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480085.760734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793600 00000100:00100000:0.0:1789480085.761083:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793600 00000100:00100000:0.0:1789480085.761156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1789480085.761167:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11349:x1876405526793600:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:0.0:1789480085.761763:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33b5 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480085.762137:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789480085.762754:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789480085.764459:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789480085.764582:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.764619:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 29 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.764631:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.764705:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 29 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.764728:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 29 pid: 11710 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.764746:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876405551968640:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480085.764875:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480085.769434:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480085.769661:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793728 00000100:00100000:1.0:1789480085.769675:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793728 00010000:00010000:1.0:1789480085.769734:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 30 pid: 11710 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480085.769793:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789480085.769805:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+30:2347:x1876405526793728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480085.769823:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480085.769831:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 30 pid: 11710 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.769849:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 30 pid: 11710 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.769895:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:1.0:1789480085.769902:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.769913:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.769923:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.769951:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480085.770041:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+30:2347:x1876405526793728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 238us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480085.770049:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00010000:00010000:2.0:1789480085.770443:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fde39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f338b expref: 29 pid: 11710 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.770462:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876405551968640:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480085.770495:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.771959:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.771980:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480085.772166:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789480085.773419:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789480085.773610:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551968768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789480085.773707:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480085.773748:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480085.774124:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551968768 00000100:00100000:0.0:1789480085.774134:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551968768 00000100:00100000:0.0:1789480085.774205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789480085.774227:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551968768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789480085.774368:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551968768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480085.774377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480085.774651:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551968768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789480085.775747:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789480085.775860:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551968896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789480085.775922:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480085.775955:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480085.776034:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551968896 00000100:00100000:0.0:1789480085.776052:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551968896 00000100:00100000:0.0:1789480085.776113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480085.776123:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876405551968896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789480085.776777:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876405551968896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 652us (851us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789480085.776786:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480085.776921:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876405551968896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789480085.776996:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789480085.777050:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777062:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777072:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777078:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.777084:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777094:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777115:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480085.777119:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789480085.777125:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.777132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdea2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480085.778479:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789480085.778702:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789480085.778718:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378775434634ns, next at 379775431439ns, rc = 0 00000001:00080000:2.0:1789480085.778729:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789480085.778794:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480085.778799:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480085.778813:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fde8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33b5 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.778966:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11349:x1876405526793600:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 17800us (18842us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789480085.778976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000020:00080000:2.0:1789480085.778983:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789480085.784934:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.785046:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526793856 00000100:00100000:3.0:1789480085.785060:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526793856 00000100:00100000:3.0:1789480085.785139:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:3.0:1789480085.785151:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11349:x1876405526793856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480085.785196:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480085.785231:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdea9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.785362:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33bc expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.785380:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33bc expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480085.785403:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480085.785407:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480085.785412:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480085.785485:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+33:11349:x1876405526793856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 336us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480085.785492:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:1.0:1789480085.789542:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.789703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526794112 00000100:00100000:3.0:1789480085.789717:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526794112 00000100:00100000:3.0:1789480085.789832:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480085.789845:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+33:11349:x1876405526794112:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480085.790332:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11349:x1876405526794112:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 487us (813us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789480085.790342:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1789480085.892249:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.892861:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526794368 00000100:00100000:2.0:1789480085.892877:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526794368 00000100:00100000:2.0:1789480085.893964:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1789480085.893987:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11359:x1876405526794368:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480085.894024:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480085.894055:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdeb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33c3 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480085.894189:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789480085.894374:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdeb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33c3 expref: 36 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.894393:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:2.0:1789480085.894396:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480085.894403:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdeb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33c3 expref: 36 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.894445:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe800, rc 0) 00000100:00100000:2.0:1789480085.894618:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11359:x1876405526794368:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 639us (2384us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789480085.894628:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:0.0:1789480085.899996:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480085.900997:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526794496 00000100:00100000:1.0:1789480085.901015:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526794496 00000100:00100000:1.0:1789480085.901159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:1.0:1789480085.901173:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11359:x1876405526794496:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789480085.901332:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901353:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901368:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901386:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901410:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901417:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901543:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901552:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901558:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480085.901619:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901633:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901640:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901648:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901656:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.901661:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901670:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901691:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480085.901694:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.901701:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901707:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901722:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901728:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901733:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901738:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.901740:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901746:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901766:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf300) 00010000:00010000:1.0:1789480085.901769:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.901772:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901778:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901805:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901812:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901818:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901823:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480085.901826:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901832:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901839:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480085.901841:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480085.901844:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480085.901850:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480085.901939:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11359:x1876405526794496:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 768us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480085.901948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:0.0:1789480085.906981:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.907064:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526794752 00000100:00100000:2.0:1789480085.907079:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526794752 00000100:00100000:2.0:1789480085.907153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1789480085.907167:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11359:x1876405526794752:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480085.907960:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11359:x1876405526794752:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 790us (989us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789480085.907972:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1789480085.945486:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.948734:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526795008 00000100:00100000:2.0:1789480085.948761:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526795008 00000100:00100000:2.0:1789480085.948992:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:2.0:1789480085.949008:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11362:x1876405526795008:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480085.949047:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480085.949078:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fded3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33ca expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949182:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949201:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949215:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949266:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949274:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949301:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949459:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949469:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949476:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480085.949487:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789480085.949638:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949648:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949656:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949662:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.949667:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949684:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949698:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480085.949701:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480085.949707:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949713:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdeda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949727:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949733:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949738:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949743:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.949746:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949751:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949757:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804d400) 00010000:00010000:2.0:1789480085.949760:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480085.949762:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949842:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fded3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949857:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.949864:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480085.949867:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480085.949869:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffa00, rc 0) 00000100:00100000:2.0:1789480085.949965:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11362:x1876405526795008:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 961us (4496us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789480085.949973:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:0.0:1789480085.955891:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480085.956045:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526795136 00000100:00100000:2.0:1789480085.956059:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526795136 00000100:00100000:2.0:1789480085.956132:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:2.0:1789480085.956145:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11362:x1876405526795136:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789480085.956241:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956263:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956279:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956355:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956362:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956368:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956374:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480085.956379:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956388:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956401:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480085.956405:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480085.956411:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480085.956417:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480085.956519:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11362:x1876405526795136:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 377us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480085.956527:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:0.0:1789480085.960986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480085.961515:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526795392 00000100:00100000:3.0:1789480085.961528:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526795392 00000100:00100000:3.0:1789480085.961620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1789480085.961636:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11362:x1876405526795392:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480085.961977:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+39:11362:x1876405526795392:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 344us (1006us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789480085.961986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1789480086.301498:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480086.301640:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526795648 00000100:00100000:1.0:1789480086.301656:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526795648 00000100:00100000:1.0:1789480086.301744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:1.0:1789480086.301778:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+39:11393:x1876405526795648:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789480086.302027:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480086.302060:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdefd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33d1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.302213:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.302232:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.302440:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480086.302458:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789480086.302663:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdefd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d1 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.302693:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d1 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.302704:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480086.302707:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480086.302712:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2200, rc 0) 00000100:00100000:1.0:1789480086.303553:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11393:x1876405526795648:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1768us (2060us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789480086.303569:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:0.0:1789480086.314824:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480086.317344:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526795776 00000100:00100000:2.0:1789480086.317367:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526795776 00000100:00100000:2.0:1789480086.317487:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480086.317519:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+41:2348:x1876405526795776:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480086.317541:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480086.317577:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d1 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.317614:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480086.317621:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480086.317720:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+40:2348:x1876405526795776:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 204us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480086.317729:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480086.330861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480086.331058:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526796032 00000100:00100000:2.0:1789480086.331072:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526796032 00000100:00100000:2.0:1789480086.331158:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1789480086.331171:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+40:11393:x1876405526796032:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1789480086.331655:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11393:x1876405526796032:12345-192.168.204.54@tcp:35:cat.0 Request processed in 484us (807us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789480086.331665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1789480086.429187:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480086.434743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526796288 00000100:00100000:2.0:1789480086.434768:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526796288 00000100:00100000:3.0:1789480086.434971:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:3.0:1789480086.434985:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11399:x1876405526796288:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:3.0:1789480086.435022:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480086.435027:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480086.435066:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fde6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33a7 expref: 41 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.435095:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480086.435102:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480086.435119:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33d8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.436718:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.436749:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.436760:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.436834:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.439647:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 41 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480086.441528:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd747800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551969024:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480086.441696:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480086.450642:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480086.453277:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526796416 00000100:00100000:1.0:1789480086.453350:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526796416 00010000:00010000:1.0:1789480086.453460:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 42 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480086.453511:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789480086.453522:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+42:2348:x1876405526796416:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480086.453545:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480086.453554:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 42 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.453573:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 42 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.453613:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480086.453619:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.453630:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.453639:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.453664:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480086.453742:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+42:2348:x1876405526796416:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 221us (3112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480086.453750:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00010000:00010000:3.0:1789480086.462958:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fdee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ca expref: 41 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480086.462995:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd747800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551969024:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480086.463030:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.463042:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.463049:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480086.463076:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789480086.463942:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.463967:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.464005:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480086.464009:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480086.464015:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480086.464098:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11399:x1876405526796288:12345-192.168.204.54@tcp:101:dd.0 Request processed in 29116us (34928us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789480086.464108:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:0.0:1789480086.470702:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480086.471051:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526796672 00000100:00100000:3.0:1789480086.471065:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526796672 00000100:00100000:3.0:1789480086.471150:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:3.0:1789480086.471163:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11399:x1876405526796672:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:3.0:1789480086.471755:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.471779:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.471806:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480086.476025:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789480086.476149:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001687b200 reply state 00000000bd396bcd transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480086.476165:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480086.478133:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+44:11399:x1876405526796672:12345-192.168.204.54@tcp:36:dd.0 Request processed in 6956us (7433us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789480086.478149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000020:00080000:2.0:1789480086.478366:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789480086.482573:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482606:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482634:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482640:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480086.482646:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482656:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482676:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480086.482680:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480086.482686:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.482692:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fdf27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.618628:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480086.810998:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480086.811014:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480086.811353:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789480086.811362:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480086.852119:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480086.852421:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526796800 00000100:00100000:1.0:1789480086.852438:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526796800 00000100:00100000:1.0:1789480086.852522:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:1.0:1789480086.852537:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+43:11413:x1876405526796800:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1789480086.852570:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480086.852608:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdf2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33df expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.852709:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.852726:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.852970:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.852990:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.852998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853006:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853124:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853138:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853148:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853374:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.853396:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 44 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480086.853412:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551969152:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480086.853604:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480086.860999:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480086.861119:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526797056 00000100:00100000:2.0:1789480086.861132:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526797056 00000100:00100000:2.0:1789480086.861230:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1789480086.861244:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+45:5589:x1876405526797056:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789480086.861771:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+46:5589:x1876405526797056:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 528us (785us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789480086.861780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1789480086.865551:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480086.866201:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551969152:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480086.866246:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480086.866591:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526797184 00000100:00100000:2.0:1789480086.866602:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526797184 00010000:00010000:2.0:1789480086.866656:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 46 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480086.866709:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789480086.866721:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+46:2348:x1876405526797184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480086.866743:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480086.866751:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 46 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866769:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 46 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866797:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fdf19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33d8 expref: 46 pid: 5831 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866817:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480086.866840:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866852:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866861:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480086.866898:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480086.866993:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867003:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480086.867064:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789480086.867070:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480086.867097:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867119:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867131:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867138:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867145:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867151:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480086.867156:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867165:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867175:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480086.867179:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480086.867183:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867189:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2800/0xbb972366037fdf35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867200:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867207:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867220:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867225:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480086.867229:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867235:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867243:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf300) 00010000:00010000:3.0:1789480086.867245:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480086.867248:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867253:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2200/0xbb972366037fdf3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480086.867404:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+46:2348:x1876405526797184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 682us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480086.867413:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00010000:00010000:3.0:1789480086.867494:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037fdf2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33df expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867512:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33df expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.867520:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480086.867522:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480086.867525:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147c00, rc 0) 00000100:00100000:3.0:1789480086.867560:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+44:11413:x1876405526796800:12345-192.168.204.54@tcp:101:stat.0 Request processed in 15028us (15655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480086.867586:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000001:00080000:2.0:1789480086.967809:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967425 is committed 00000001:00080000:2.0:1789480086.967941:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000001:00080000:2.0:1789480086.967952:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:2.0:1789480086.967972:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789480086.968357:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551969280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789480086.968455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480086.968764:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969280 00000100:00100000:0.0:1789480086.968774:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969280 00000100:00100000:0.0:1789480086.968880:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789480086.968891:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405551969280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789480086.968928:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1789480086.968973:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94c95, atime: 0x6aa94c96, ctime: 0x6aa94c95, blocks: 0x1 00010000:00010000:0.0:1789480086.968984:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480086.969004:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789480086.969010:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480086.969019:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480086.969041:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480086.969053:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480086.969061:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480086.969255:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480086.969735:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480086.969744:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.969756:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480086.969760:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.969773:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.969795:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.969803:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003aa4aec/0xbb972366037fdf4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480086.969825:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480086.969827:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480086.969829:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480086.970192:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480086.970609:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876405551969280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1716us (2150us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789480086.970620:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000020:00080000:2.0:1789480086.970825:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d22bb29cc00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789480086.970832:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bacf6500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bb29c780 00000020:00080000:2.0:1789480086.970836:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bacf6700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22baff9c00 00000020:00080000:3.0:1789480086.970948:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789480086.971225:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1789480086.971707:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bd69b480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789480086.971733:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551969280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789480086.976970:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480086.977078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526797440 00000100:00100000:3.0:1789480086.977093:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526797440 00000100:00100000:3.0:1789480086.977177:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:3.0:1789480086.977192:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+16:11419:x1876405526797440:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:3.0:1789480086.977323:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480086.977360:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdf43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33df expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.977384:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480086.977391:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480086.978142:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.978175:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.978189:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480086.978464:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789480086.978498:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000175efb9b reply state 00000000d2167bec transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480086.978509:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480086.978722:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11419:x1876405526797440:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1530us (1779us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789480086.978750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00000020:00080000:3.0:1789480086.978756:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480086.982123:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982152:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982172:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982180:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480086.982187:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982196:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982229:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480086.982232:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480086.982239:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480086.982246:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480087.168788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.169051:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526797568 00000100:00100000:2.0:1789480087.169066:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526797568 00000100:00100000:2.0:1789480087.169177:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:2.0:1789480087.169191:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+17:11433:x1876405526797568:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789480087.169225:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480087.169257:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdf58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169393:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169422:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169441:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169459:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169466:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169472:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169865:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169875:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.169883:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480087.169930:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789480087.169935:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:3.0:1789480087.170203:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1789480087.170741:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170759:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170784:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170792:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170800:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170807:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480087.170812:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170821:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170838:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480087.170841:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480087.170848:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170855:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fdf5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170873:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170880:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170886:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170898:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480087.170902:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170908:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170916:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804d400) 00010000:00010000:2.0:1789480087.170919:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480087.170922:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.170927:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.171852:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdf58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.171879:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.171888:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480087.171891:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480087.171894:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480087.171993:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11433:x1876405526797568:12345-192.168.204.54@tcp:101:stat.0 Request processed in 2805us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.172002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:0.0:1789480087.348071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.348767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526797824 00000100:00100000:3.0:1789480087.348782:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526797824 00000100:00100000:3.0:1789480087.348875:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:3.0:1789480087.348889:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11443:x1876405526797824:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480087.348932:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480087.348965:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33ed expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480087.349098:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789480087.349595:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ed expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.349613:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:3.0:1789480087.349616:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480087.349623:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fdf74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33ed expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.349639:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5400, rc 0) 00000100:00100000:3.0:1789480087.349733:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11443:x1876405526797824:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 847us (1727us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789480087.349743:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:0.0:1789480087.356587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.356741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798080 00000100:00100000:2.0:1789480087.356776:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798080 00000100:00100000:2.0:1789480087.356857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789480087.356870:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286ead450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11443:x1876405526798080:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480087.359256:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286ead450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11443:x1876405526798080:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 2372us (2677us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789480087.359275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1789480087.387036:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551969664:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480087.387187:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551969792:0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387227:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480087.387257:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789480087.387264:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551969408:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387320:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789480087.387328:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551969536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387337:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480087.387352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480087.387363:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd69bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551969920:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387369:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551970048:0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480087.387421:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969408 00000100:00100000:1.0:1789480087.387432:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969408 00000100:00100000:2.0:1789480087.387456:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480087.387489:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969792 00000100:00100000:2.0:1789480087.387493:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969792 00000100:00100000:1.0:1789480087.387497:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789480087.387505:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387532:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551970048 00000100:00100000:2.0:1789480087.387534:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551970048 00000100:00100000:2.0:1789480087.387553:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789480087.387560:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551969792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387562:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551969408:12345-0@lo:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.387582:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789480087.387606:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551969792:12345-0@lo:400:kworker.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.387613:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789480087.387622:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789480087.387629:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551970048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387637:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969664 00000100:00100000:2.0:1789480087.387640:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969664 00000100:00100000:1.0:1789480087.387665:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551970048:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.387668:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969536 00000100:00100000:2.0:1789480087.387671:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969536 00000100:00100000:1.0:1789480087.387671:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789480087.387686:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551969920 00000100:00100000:2.0:1789480087.387706:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551969920 00000100:00100000:1.0:1789480087.387714:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551970048:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387724:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789480087.387729:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551969664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387741:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4bb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551969408:0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387751:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551969792:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387764:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551969664:12345-0@lo:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.387770:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789480087.387776:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551969664:0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387781:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789480087.387804:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551969536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387827:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789480087.387834:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551969536:12345-0@lo:400:kworker.0 Request processed in 48us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.387834:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551969920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480087.387839:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789480087.387862:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551969536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480087.387869:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551969920:12345-0@lo:400:kworker.0 Request processed in 36us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.387875:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789480087.387900:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd69bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551969920:0@lo:400:kworker.0 00000100:00080000:3.0:1789480087.388460:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480087.388468:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480087.440127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.440272:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798336 00000100:00100000:2.0:1789480087.440385:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798336 00000100:00100000:2.0:1789480087.440541:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:2.0:1789480087.440553:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11449:x1876405526798336:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480087.440598:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480087.440627:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdf82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33f4 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.440788:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.440808:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.440820:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.440881:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.440899:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 21 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480087.440915:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551970176:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480087.441096:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480087.445115:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551970176:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480087.445223:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480087.447561:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.447744:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798464 00000100:00100000:3.0:1789480087.447759:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798464 00010000:00010000:3.0:1789480087.447821:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 22 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480087.447871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1789480087.447883:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+22:2345:x1876405526798464:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480087.447903:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480087.447935:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 22 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.447953:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 22 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.447982:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fdf6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33e6 expref: 22 pid: 5830 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.448003:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480087.448009:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.448021:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.448031:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.448068:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480087.448146:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+21:2345:x1876405526798464:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 265us (599us total) trans 0 rc 0/0 00010000:00010000:2.0:1789480087.448261:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.448274:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480087.448471:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000004:00200000:2.0:1789480087.448530:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789480087.448762:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fdf82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 22 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.448782:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 21 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.448790:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480087.448793:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480087.448805:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:2.0:1789480087.448854:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+21:11449:x1876405526798336:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8304us (8797us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789480087.448863:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:0.0:1789480087.451593:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480087.451761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798720 00000100:00100000:1.0:1789480087.451774:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798720 00000100:00100000:1.0:1789480087.451857:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:1.0:1789480087.451870:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+21:11449:x1876405526798720:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1789480087.452495:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.452520:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.452534:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480087.452623:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789480087.452738:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000964a745c reply state 00000000a2482d0d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480087.452750:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480087.452894:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11449:x1876405526798720:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1022us (1323us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789480087.452903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000020:00080000:1.0:1789480087.452910:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789480087.460736:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460829:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460839:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460846:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480087.460853:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460863:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460885:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:0.0:1789480087.460889:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480087.460895:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.460901:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdf97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480087.461607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480087.464874:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798848 00000100:00100000:0.0:1789480087.464899:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798848 00000100:00100000:0.0:1789480087.464990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:0.0:1789480087.465023:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11449:x1876405526798848:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480087.465060:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480087.465091:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdf9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f33fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.465718:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.465739:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 24 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.465750:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.465806:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 24 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.465826:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 24 pid: 11710 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480087.465841:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551970304:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480087.465975:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789480087.469265:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.470676:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526798976 00000100:00100000:2.0:1789480087.470694:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526798976 00010000:00010000:2.0:1789480087.470757:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 25 pid: 11710 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480087.471026:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1789480087.471038:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+25:2348:x1876405526798976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480087.471060:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480087.471070:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 25 pid: 11710 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.471087:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 25 pid: 11710 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.471114:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480087.471120:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.471130:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.471138:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.471275:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480087.471517:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+25:2348:x1876405526798976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 480us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.471526:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:3.0:1789480087.474543:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fdf89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33f4 expref: 24 pid: 11710 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480087.474588:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876405551970304:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480087.474621:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.474991:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.475000:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480087.475068:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789480087.475074:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480087.475100:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.475480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fdf9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33fb expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.475510:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33fb expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.475521:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480087.475524:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480087.475529:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6600, rc 0) 00000100:00100000:2.0:1789480087.475742:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11449:x1876405526798848:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10722us (14143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.475753:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:2.0:1789480087.480009:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.480204:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526799232 00000100:00100000:3.0:1789480087.480218:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526799232 00000100:00100000:3.0:1789480087.480467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1789480087.480481:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11449:x1876405526799232:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789480087.480986:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11449:x1876405526799232:12345-192.168.204.54@tcp:35:bash.0 Request processed in 507us (990us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789480087.480996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1789480087.558998:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480087.559122:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526799488 00000100:00100000:0.0:1789480087.559136:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526799488 00000100:00100000:0.0:1789480087.559471:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:0.0:1789480087.559484:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11459:x1876405526799488:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480087.559519:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480087.559562:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fdfac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3402 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480087.559875:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789480087.560035:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fdfac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3402 expref: 26 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.560052:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:0.0:1789480087.560055:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480087.560061:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fdfac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3402 expref: 26 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.560081:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7400, rc 0) 00000100:00100000:0.0:1789480087.560449:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11459:x1876405526799488:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 966us (1465us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789480087.560458:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:0.0:1789480087.564989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480087.565089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526799616 00000100:00100000:1.0:1789480087.565103:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526799616 00000100:00100000:1.0:1789480087.565371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:1.0:1789480087.565384:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11459:x1876405526799616:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789480087.565491:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.565513:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.565526:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.565543:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.565550:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.565557:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566030:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566041:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566049:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480087.566105:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566130:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566137:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566158:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566165:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480087.566170:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566180:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.566194:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480087.566197:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480087.566203:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567383:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fdfba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567407:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567414:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567422:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567442:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480087.567446:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567454:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567469:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedfa00) 00010000:00010000:1.0:1789480087.567472:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480087.567477:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567482:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fdfc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567504:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567510:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567516:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567522:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480087.567525:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567531:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567550:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480087.567553:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480087.567556:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.567562:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdfc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480087.568105:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11459:x1876405526799616:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 2718us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.568118:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1789480087.573951:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.574075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526799872 00000100:00100000:3.0:1789480087.574089:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526799872 00000100:00100000:3.0:1789480087.574264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1789480087.574277:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11459:x1876405526799872:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480087.574657:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11459:x1876405526799872:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 382us (720us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789480087.574666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789480087.629490:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480087.629618:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526800128 00000100:00100000:0.0:1789480087.629709:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526800128 00000100:00100000:0.0:1789480087.629851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1789480087.629864:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11462:x1876405526800128:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480087.629899:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480087.629927:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdfcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630038:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630097:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630118:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630126:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630133:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630890:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdfe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630905:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.630915:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480087.630928:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480087.631060:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631069:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631078:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631093:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480087.631100:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631109:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631125:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:0.0:1789480087.631129:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480087.631136:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631154:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fdfd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631174:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631181:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631187:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631192:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480087.631195:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631200:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631525:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480087.631528:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480087.631532:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631538:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fdfdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631614:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fdfcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3409 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631642:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3409 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480087.631650:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:0.0:1789480087.631653:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480087.631656:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6800, rc 0) 00000100:00100000:0.0:1789480087.631759:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11462:x1876405526800128:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1889us (2276us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789480087.631769:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1789480087.636956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480087.637016:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.637112:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526800256 00000100:00100000:2.0:1789480087.637125:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526800256 00000100:00100000:2.0:1789480087.637229:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1789480087.637242:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:2348:x1876405526800256:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480087.637264:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480087.637326:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fdfe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3409 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.637353:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:2.0:1789480087.637360:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480087.637437:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+27:2348:x1876405526800256:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.637446:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480087.638916:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526800384 00000100:00100000:1.0:1789480087.638932:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526800384 00000100:00100000:1.0:1789480087.639003:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1789480087.639013:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+27:11462:x1876405526800384:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789480087.639106:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639128:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639141:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639194:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639203:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639244:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639250:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480087.639255:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639265:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639278:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480087.639310:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480087.639317:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.639324:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480087.639428:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+27:11462:x1876405526800384:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 415us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.639438:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00010000:00010000:1.0:1789480087.643779:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480087.656140:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.656352:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526800640 00000100:00100000:2.0:1789480087.656366:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526800640 00000100:00100000:2.0:1789480087.656445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1789480087.656458:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+27:11462:x1876405526800640:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480087.656814:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11462:x1876405526800640:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 358us (690us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789480087.656823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1789480087.881450:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480087.881636:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526800896 00000100:00100000:1.0:1789480087.881651:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526800896 00000100:00100000:1.0:1789480087.881733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:1.0:1789480087.881745:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11480:x1876405526800896:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1789480087.881777:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480087.881806:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3410 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.881968:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe000 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.881986:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe000 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.882000:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe000 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480087.882014:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789480087.882182:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fdff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3410 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.882206:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe000 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3410 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480087.882216:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:1.0:1789480087.882220:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789480087.882224:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2147c00, rc 0) 00000100:00100000:1.0:1789480087.882396:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11480:x1876405526800896:12345-192.168.204.54@tcp:101:cat.0 Request processed in 653us (963us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789480087.882405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1789480087.913403:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.913613:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801024 00000100:00100000:2.0:1789480087.913638:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801024 00000100:00100000:2.0:1789480087.913722:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1789480087.913736:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11481:x1876405526801024:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480087.913784:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480087.913836:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.913949:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.913966:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.913982:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480087.914029:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789480087.914034:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480087.914056:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.914089:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3417 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.914112:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3417 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.914122:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480087.914125:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480087.914130:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480087.914785:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11481:x1876405526801024:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1047us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.914795:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1789480087.928538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.929073:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801408 00000100:00100000:3.0:1789480087.929090:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801408 00000100:00100000:3.0:1789480087.929181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1789480087.929197:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11481:x1876405526801408:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480087.930321:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11481:x1876405526801408:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1085us (1755us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789480087.930333:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1789480087.941789:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.941975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801536 00000100:00100000:3.0:1789480087.941988:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801536 00000100:00100000:3.0:1789480087.942217:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480087.942231:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11481:x1876405526801536:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:3.0:1789480087.942271:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789480087.942343:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fdfa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33fb expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.942375:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3410 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.942513:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fdea9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f33bc expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.942524:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22b7076600) 00010000:00010000:3.0:1789480087.942539:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480087.942654:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11481:x1876405526801536:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 425us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480087.942664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789480087.946528:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480087.946813:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801664 00000100:00100000:2.0:1789480087.946828:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801664 00000100:00100000:2.0:1789480087.946907:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1789480087.946920:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11481:x1876405526801664:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1789480087.947074:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.947094:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480087.947109:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480087.948977:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789480087.949134:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11481:x1876405526801664:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 2208us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.950543:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1789480087.991872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480087.992012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801792 00000100:00100000:3.0:1789480087.992028:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801792 00000100:00100000:3.0:1789480087.992113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:3.0:1789480087.992124:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11483:x1876405526801792:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480087.992153:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480087.992186:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f341e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992278:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992353:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992387:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992406:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992413:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992419:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992806:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992817:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992825:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480087.992880:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789480087.992884:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480087.992910:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992923:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992934:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992953:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992961:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992968:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480087.992974:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.992985:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993001:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480087.993004:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480087.993011:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993017:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe02a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993033:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993039:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993045:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993049:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480087.993059:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993065:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993072:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22b7076600) 00010000:00010000:3.0:1789480087.993075:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480087.993077:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993083:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993122:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993136:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480087.993143:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:3.0:1789480087.993146:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480087.993148:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480087.993232:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11483:x1876405526801792:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1109us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480087.993241:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1789480088.432343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480088.432397:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480088.432435:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480088.432454:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480088.432502:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480088.432538:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802304 00000100:00100000:1.0:1789480088.432563:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802304 00000100:00100000:1.0:1789480088.432641:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802176 00000100:00100000:1.0:1789480088.432644:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802176 00000100:00100000:1.0:1789480088.432673:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1789480088.432686:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526802304:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480088.432778:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526802304:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 97us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480088.432787:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1789480088.432805:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1789480088.432812:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526802176:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480088.432834:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2346:x1876405526802176:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480088.432839:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1789480088.432862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802048 00000100:00100000:1.0:1789480088.432866:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802048 00000100:00100000:1.0:1789480088.432893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802432 00000100:00100000:1.0:1789480088.432896:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802432 00000100:00100000:1.0:1789480088.432913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1789480088.432919:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+30:2346:x1876405526802048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480088.432946:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+30:2346:x1876405526802048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480088.432951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1789480088.432961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:1.0:1789480088.432966:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526802432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480088.432997:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526802432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480088.433003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1789480088.433261:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526801920 00000100:00100000:3.0:1789480088.433267:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526801920 00000100:00100000:3.0:1789480088.433322:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00100000:3.0:1789480088.433329:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526801920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480088.433365:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526801920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480088.433371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 301 00000100:00080000:3.0:1789480088.433404:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480088.433411:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480088.433414:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789480088.668072:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480088.858628:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480088.858647:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480088.858713:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789480088.858721:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480088.858906:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551970432:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480088.859042:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480088.877989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480088.878069:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802560 00000100:00100000:3.0:1789480088.878080:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802560 00000100:00100000:3.0:1789480088.878159:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1789480088.878171:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526802560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480088.878220:0:11710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480088.878397:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526802560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 227us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480088.878406:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:0.0:1789480088.881700:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551970432:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480088.883083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480088.883707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802688 00000100:00100000:3.0:1789480088.883720:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802688 00000100:00100000:3.0:1789480088.883796:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1789480088.883807:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11494:x1876405526802688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789480088.883902:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.883922:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.883939:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.883955:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.883984:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.883991:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884028:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884038:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884045:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480088.884095:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789480088.884100:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480088.884116:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884141:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884149:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884157:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884163:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480088.884168:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884184:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884199:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:3.0:1789480088.884202:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480088.884217:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884224:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe03f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884242:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884248:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884255:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884261:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480088.884263:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884269:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.884276:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d22b7076200) 00010000:00010000:3.0:1789480088.884279:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480088.885376:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885398:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe046 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885581:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885588:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885595:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885667:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480088.885672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885680:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885695:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:3.0:1789480088.885697:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480088.885700:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.885705:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe04d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480088.888137:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11494:x1876405526802688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 4315us (5045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480088.888155:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:0.0:1789480088.903245:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480088.905052:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526802944 00000100:00100000:0.0:1789480088.905074:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526802944 00000100:00100000:0.0:1789480088.905172:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1789480088.905186:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+30:11494:x1876405526802944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480088.905217:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480088.905247:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe054 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3425 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905409:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905439:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905456:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480088.905469:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480088.905791:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905822:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905830:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905837:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480088.905842:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905850:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905865:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:0.0:1789480088.905869:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480088.905874:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905881:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe05b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905941:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe054 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3425 expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905952:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480088.905954:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480088.905958:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe054 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3425 expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480088.905968:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7800, rc 0) 00000100:00100000:0.0:1789480088.906069:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526802944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 885us (2838us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1789480088.906078:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1789480088.915341:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480088.915396:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526803072 00000100:00100000:0.0:1789480088.915409:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526803072 00000100:00100000:0.0:1789480088.915493:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1789480088.915506:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526803072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789480088.915566:0:11710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480088.915713:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526803072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 208us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480088.915721:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:0.0:1789480088.923562:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480088.924806:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526803328 00000100:00100000:3.0:1789480088.924824:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526803328 00000100:00100000:3.0:1789480088.924921:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1789480088.924934:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526803328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480088.924963:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480088.924966:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480088.925003:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3417 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.925027:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480088.925033:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480088.925048:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe069 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f342c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480088.930231:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789480088.934067:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.934097:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.934111:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.934215:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe069 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f342c expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.934238:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f342c expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.934269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d22b7076200) 00010000:00010000:3.0:1789480088.934272:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480088.934276:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480088.939919:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11494:x1876405526803328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 14968us (16360us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789480088.939940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:0.0:1789480088.954712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480088.955430:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526803584 00000100:00100000:3.0:1789480088.955447:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526803584 00000100:00100000:3.0:1789480088.955533:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:3.0:1789480088.955557:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11494:x1876405526803584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480088.955796:0:11710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480088.955833:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f342c expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.955858:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d22b7076200) 00010000:00010000:3.0:1789480088.955872:0:11710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480088.955902:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.955920:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.955933:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.963366:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.963395:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.963415:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964034:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964045:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964061:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964068:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480088.964074:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964085:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964101:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480088.964105:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480088.964110:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964117:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe07e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964131:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964138:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964144:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964149:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480088.964152:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964168:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964176:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x931d88ce (ffff8d228804d100) 00010000:00010000:2.0:1789480088.964179:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480088.964182:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.964189:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff000/0xbb972366037fe085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x931d88ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480088.967854:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526803584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 12283us (13141us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789480088.967870:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1789480088.971854:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480088.971961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526803712 00000100:00100000:2.0:1789480088.971975:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526803712 00000100:00100000:2.0:1789480088.972057:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1789480088.972071:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11494:x1876405526803712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480088.972098:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480088.972130:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe08c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3433 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972180:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972198:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972214:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972391:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe08c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972414:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480088.972491:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:2.0:1789480088.972494:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480088.972500:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe600, rc 0) 00000100:00100000:2.0:1789480088.972792:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11494:x1876405526803712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 724us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480088.972799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:1.0:1789480088.987131:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480088.993611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526803968 00000100:00100000:3.0:1789480088.993638:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526803968 00000100:00100000:3.0:1789480088.993766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:3.0:1789480088.993780:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11494:x1876405526803968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480088.993902:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.993925:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480088.993941:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480088.994415:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789480088.995772:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381992486974ns, next at 382992478996ns, rc = 0 00000004:00010000:3.0:1789480088.995942:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7c895e4 reply state 00000000308164c5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480088.995957:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480088.996755:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11494:x1876405526803968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2969us (9639us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789480088.996767:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:1.0:1789480089.010865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480089.011659:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804096 00000100:00100000:2.0:1789480089.011676:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804096 00000100:00100000:2.0:1789480089.011782:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:2.0:1789480089.011796:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11494:x1876405526804096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480089.011831:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480089.011858:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f343a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.011941:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.011961:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.012005:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:2.0:1789480089.012008:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480089.012013:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffee00, rc 0) 00000100:00100000:2.0:1789480089.012092:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11494:x1876405526804096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 300us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480089.012099:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00080000:0.0:1789480089.014659:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480089.019550:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019574:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019583:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019589:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480089.019595:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019624:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019646:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:3.0:1789480089.019649:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480089.019655:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.019661:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe09a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.020039:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.021708:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804224 00000100:00100000:3.0:1789480089.021729:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804224 00000100:00100000:3.0:1789480089.021810:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1789480089.021825:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2345:x1876405526804224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789480089.022390:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2345:x1876405526804224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 566us (2355us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789480089.022400:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1789480089.028997:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480089.030257:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804480 00000100:00100000:0.0:1789480089.030274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804480 00000100:00100000:0.0:1789480089.030389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480089.030401:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11494:x1876405526804480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480089.030767:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11494:x1876405526804480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 367us (1786us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789480089.030776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1789480089.044346:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480089.044710:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804736 00000100:00100000:1.0:1789480089.044724:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804736 00000100:00100000:1.0:1789480089.044805:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:1.0:1789480089.044817:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11494:x1876405526804736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480089.044974:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11494:x1876405526804736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 159us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.044983:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:2.0:1789480089.056515:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.056918:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804864 00000100:00100000:3.0:1789480089.056932:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804864 00000100:00100000:3.0:1789480089.057010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:3.0:1789480089.057025:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11494:x1876405526804864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480089.057055:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480089.057082:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3441 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057313:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057335:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057351:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480089.057401:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480089.057554:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057594:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3441 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057695:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3441 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.057704:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:3.0:1789480089.057708:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480089.057712:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480089.057790:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11494:x1876405526804864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 768us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.057798:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1789480089.065330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.065527:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526804992 00000100:00100000:3.0:1789480089.065549:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526804992 00000100:00100000:3.0:1789480089.065700:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1789480089.065724:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526804992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480089.065752:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480089.065782:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3448 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480089.065819:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c99, blocks: 0x1 00010000:00010000:3.0:1789480089.065845:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1789480089.065851:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480089.065861:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.065884:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.065899:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480089.067617:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2346:x1876405526804992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1882us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.067631:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1789480089.078858:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480089.079555:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805248 00000100:00100000:1.0:1789480089.079570:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805248 00000100:00100000:1.0:1789480089.079653:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:1.0:1789480089.079664:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11494:x1876405526805248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480089.079812:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c1e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11494:x1876405526805248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 149us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.079820:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:1.0:1789480089.084733:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480089.084871:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805376 00000100:00100000:2.0:1789480089.084886:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805376 00000100:00100000:2.0:1789480089.084957:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1789480089.084968:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:11494:x1876405526805376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480089.084994:0:12025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480089.085020:0:12025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f344f expref: -99 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.085064:0:12025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.085073:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480089.085078:0:12025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480089.085084:0:12025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 9 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.085141:0:12025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.085159:0:12025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.085174:0:12025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12025:1876405551970560:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480089.085340:0:12025:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789480089.089339:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480089.089488:0:12025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12025:1876405551970560:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480089.089532:0:12025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 9 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.089567:0:12025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff800, rc 0) 00000100:00100000:2.0:1789480089.089637:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+9:11494:x1876405526805376:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4671us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480089.089648:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789480089.092167:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805504 00000100:00100000:3.0:1789480089.092184:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805504 00010000:00010000:3.0:1789480089.094549:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.095708:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1789480089.095731:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526805504:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480089.095771:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480089.095808:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.095831:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.095859:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c7ff81/0xbb972366037fe0b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3448 expref: 9 pid: 6686 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.095878:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480089.095882:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480089.095891:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.095902:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.095955:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.095972:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd745180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551970688:192.168.204.54@tcp:105: 00000100:00100000:3.0:1789480089.096080:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480089.101743:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd745180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551970688:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789480089.101782:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480089.101856:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526805504:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6135us (12529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.101868:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:3.0:1789480089.106213:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.106267:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805632 00000100:00100000:3.0:1789480089.106279:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805632 00002000:00100000:3.0:1789480089.106362:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d22bd745180 x1876405526805632/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:240/0 lens 504/0 e 0 to 0 dl 1789480100 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480089.106375:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd745180 with x1876405526805632 ext(0->8) 00002000:00010000:3.0:1789480089.106383:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd745180 00000100:00100000:3.0:1789480089.106425:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789480089.106438:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526805632:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789480089.107163:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2348:x1876405526805632:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 722us (958us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789480089.107173:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00002000:00100000:3.0:1789480089.107182:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d22bd745180 x1876405526805632/t4294967315(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:240/0 lens 504/448 e 0 to 0 dl 1789480100 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480089.107189:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd745180 with x1876405526805632 ext(0->8) 00002000:00010000:3.0:1789480089.107194:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd745180 00000100:00100000:1.0:1789480089.110943:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.111048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805760 00000100:00100000:3.0:1789480089.111060:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805760 00000100:00100000:3.0:1789480089.111140:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:3.0:1789480089.111151:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11494:x1876405526805760:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1789480089.169775:0:12413:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480089.169787:0:12413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480089.169839:0:12413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789480089.169847:0:12413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789480089.211348:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:0.0:1789480089.213326:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11494:x1876405526805760:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 102162us (102382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.213341:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000004:00080000:3.0:1789480089.214766:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789480089.214817:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789480089.215324:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789480089.215362:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789480089.217914:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480089.217950:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551970816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789480089.220208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480089.222241:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551970816 00000100:00100000:0.0:1789480089.222268:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551970816 00000100:00100000:0.0:1789480089.222467:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789480089.222481:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551970816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789480089.222778:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789480089.222783:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789480089 00002000:00010000:0.0:1789480089.222786:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789480089.222787:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789480089 -> 1789480089 00002000:00010000:0.0:1789480089.222790:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789480089.222900:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551970816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 422us (2701us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789480089.222908:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789480089.223461:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480089.225499:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00080000:2.0:1789480089.225618:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bfd90380/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789480089.225630:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551970816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789480089.227607:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526805888 00000100:00100000:0.0:1789480089.227627:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526805888 00000100:00100000:0.0:1789480089.227730:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1789480089.227743:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2347:x1876405526805888:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789480089.303662:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789480089.303682:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789480089.303916:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526805888:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 76166us (78424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.303932:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1789480089.317024:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.317126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806144 00000100:00100000:3.0:1789480089.317140:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806144 00000100:00100000:3.0:1789480089.317214:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:3.0:1789480089.317226:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11494:x1876405526806144:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480089.317341:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480089.317380:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe0af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3441 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.317521:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:3.0:1789480089.317527:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480089.317578:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.317596:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.317606:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480089.317942:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082b5b499 reply state 00000000f8e38fb7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.317953:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480089.318092:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11494:x1876405526806144:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 866us (1083us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789480089.318099:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00010000:00010000:2.0:1789480089.320701:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320725:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320734:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320741:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480089.320747:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320756:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320778:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:2.0:1789480089.320782:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480089.320788:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.320795:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe0c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.321620:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480089.321806:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806272 00000100:00100000:1.0:1789480089.321818:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806272 00000100:00100000:1.0:1789480089.321887:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789480089.321897:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526806272:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789480089.322247:0:12025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789480089.322251:0:12025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789480089 -> 1789480087 00002000:00010000:1.0:1789480089.322255:0:12025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789480086 00002000:00010000:1.0:1789480089.322257:0:12025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789480089 -> 1789480087 00002000:00010000:1.0:1789480089.322259:0:12025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789480089.322373:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526806272:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 476us (759us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789480089.322382:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789480089.337923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480089.338015:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806528 00000100:00100000:2.0:1789480089.338031:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806528 00000100:00100000:2.0:1789480089.338102:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:2.0:1789480089.338123:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11494:x1876405526806528:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789480089.338216:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.338248:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.338260:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.338345:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.338363:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 18 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.338380:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551970944:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480089.338705:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789480089.341663:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480089.341926:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551970944:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480089.341964:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.348847:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806656 00000100:00100000:3.0:1789480089.348867:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806656 00010000:00010000:3.0:1789480089.351321:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.351382:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:3.0:1789480089.351394:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+19:2347:x1876405526806656:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480089.351424:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480089.351432:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351457:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351486:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3433 expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351503:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:3.0:1789480089.351508:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351519:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351527:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351579:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480089.351664:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+18:2347:x1876405526806656:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 272us (10014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.351671:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:3.0:1789480089.351706:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351714:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351747:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351754:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351761:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351767:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480089.351771:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351779:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351788:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:3.0:1789480089.351791:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789480089.351795:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.351810:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe0cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.351853:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+17:11494:x1876405526806528:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 13741us (13947us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789480089.351861:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:2.0:1789480089.360549:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480089.365804:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806784 00000100:00100000:0.0:1789480089.365824:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806784 00000100:00100000:0.0:1789480089.365908:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789480089.365921:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526806784:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789480089.365984:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.366028:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.366038:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480089.366043:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480089.366048:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.366095:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.366219:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480089.366236:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551971072:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480089.366370:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480089.377322:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.377404:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526806912 00000100:00100000:3.0:1789480089.377486:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526806912 00010000:00010000:3.0:1789480089.377552:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 9 pid: 12025 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.377605:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1789480089.377615:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526806912:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480089.377632:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480089.377660:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 9 pid: 12025 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.377678:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 9 pid: 12025 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.377709:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480089.377714:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480089.377721:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.377731:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.377769:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480089.377832:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526806912:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 219us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.377840:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:3.0:1789480089.378732:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f344f expref: 8 pid: 12025 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.378756:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551971072:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480089.378783:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378794:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378801:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378837:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378844:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378852:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378870:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480089.378875:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378885:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378903:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.378910:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d888dea5/0xbb972366037fe0d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.379002:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526806784:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 13083us (18475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.379011:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:3.0:1789480089.399580:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480089.399828:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526807168 00000100:00100000:0.0:1789480089.399840:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526807168 00000100:00100000:0.0:1789480089.399913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:0.0:1789480089.399926:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+17:11494:x1876405526807168:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789480089.400038:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.400059:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.400087:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.410866:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.410909:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.410920:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.410992:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.411022:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 18 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.411039:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551971200:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480089.418370:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789480089.423648:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551971200:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480089.423696:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.424730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480089.424938:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526807296 00000100:00100000:1.0:1789480089.424949:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526807296 00010000:00010000:1.0:1789480089.425004:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480089.425080:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1789480089.425092:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:2348:x1876405526807296:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480089.425111:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480089.425119:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425135:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425188:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe0a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f343a expref: 19 pid: 5830 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425207:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:1.0:1789480089.425213:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425224:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425233:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.425267:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480089.425369:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:2348:x1876405526807296:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 277us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.425377:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:2.0:1789480089.425704:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.425716:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480089.425981:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789480089.426169:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789480089.426215:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789480089.426351:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876405551971328:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789480089.426435:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480089.426477:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480089.426621:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551971328 00000100:00100000:0.0:1789480089.426630:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551971328 00000100:00100000:0.0:1789480089.426692:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480089.426703:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1876405551971328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789480089.426795:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1876405551971328:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.426802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480089.426843:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789480089.426848:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bfd90380, transno 4294967316 00000100:00100000:0.0:1789480089.426862:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876405551971328:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789480089.427399:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789480089.427486:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876405551971456:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789480089.427537:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480089.427562:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480089.427791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551971456 00000100:00100000:0.0:1789480089.427798:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551971456 00000100:00100000:0.0:1789480089.427824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480089.427830:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1876405551971456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789480089.428001:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1876405551971456:12345-0@lo:1000:mdt00_002.0 Request processed in 170us (472us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789480089.428008:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480089.428048:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876405551971456:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789480089.428094:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428104:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428113:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428121:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffa00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480089.428126:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428135:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428156:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804da00) 00010000:00010000:0.0:1789480089.428160:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480089.428166:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428174:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428212:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428219:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428225:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428243:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480089.428246:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428253:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428262:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:0.0:1789480089.428264:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480089.428267:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe01c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428324:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428340:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428351:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428382:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480089.428401:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 21 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480089.428425:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551971584:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480089.428501:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283776f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480089.430565:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551971584:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480089.430604:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480089.430921:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480089.431174:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526807424 00000100:00100000:3.0:1789480089.431184:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526807424 00010000:00010000:3.0:1789480089.431234:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 22 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480089.431275:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1789480089.431304:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+22:2347:x1876405526807424:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480089.431333:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480089.431342:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 22 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431360:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 22 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431387:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f341e expref: 22 pid: 5832 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431401:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:3.0:1789480089.431406:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431418:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431428:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480089.431451:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480089.431518:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+21:2347:x1876405526807424:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 234us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.431526:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00010000:00010000:2.0:1789480089.431700:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431709:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431724:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431731:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431738:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431745:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480089.431750:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431759:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431769:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480089.431773:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480089.431778:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431784:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7400/0xbb972366037fe0e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431800:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431813:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431820:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431825:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480089.431828:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431835:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431844:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d400) 00010000:00010000:2.0:1789480089.431846:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480089.431850:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.431855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe0d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480089.432196:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11494:x1876405526807168:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 32271us (32629us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789480089.432206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000020:00080000:2.0:1789480089.432210:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789480089.434517:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000040:00080000:0.0:1789480089.434717:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480089.434724:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480089.435204:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789480089.435219:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480089.435407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526807680 00000100:00100000:2.0:1789480089.435494:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526807680 00000100:00100000:2.0:1789480089.435569:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480089.435582:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11494:x1876405526807680:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789480089.436358:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789480089.436697:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789480089.436765:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436787:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436802:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436812:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436818:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436825:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480089.436852:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480089.436913:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480089.436923:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.436929:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480089.436934:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.436942:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.436956:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d228804d600) 00010000:00010000:1.0:1789480089.436967:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789480089.436974:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.436980:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe0ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480089.436998:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480089.436999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480089.437001:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480089.437124:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+22:11494:x1876405526807680:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1540us (2615us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789480089.437134:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000020:00080000:2.0:1789480089.437141:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789480089.471623:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789480089.471644:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1789480089.694412:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480089.947717:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551971712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480089.948048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480089.952550:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551971712 00000100:00100000:2.0:1789480089.952576:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551971712 00000100:00100000:2.0:1789480089.952874:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789480089.952888:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551971712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480089.952985:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480089.953128:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551971712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480089.953138:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789480089.954737:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789480089.954761:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789480089.954789:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bd69b480, transno 4294967307 00000100:00100000:1.0:1789480089.954835:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551971712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789480089.962430:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480090.463542:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551971840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480090.463658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480090.464159:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551971840 00000100:00100000:2.0:1789480090.464174:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551971840 00000100:00100000:2.0:1789480090.464359:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789480090.464374:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551971840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480090.464418:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789480090.465278:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551971840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480090.465357:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551971840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 984us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480090.465368:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1789480090.714691:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480091.410245:0:12469:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480091.410260:0:12469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480091.410344:0:12469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789480091.410351:0:12469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480091.593787:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480091.597906:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526807936 00000100:00100000:2.0:1789480091.597929:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526807936 00000100:00100000:2.0:1789480091.598037:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:2.0:1789480091.598051:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+22:11513:x1876405526807936:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480091.598087:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480091.598118:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe0f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3456 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.598267:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.598305:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.598323:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480091.598355:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789480091.598533:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe0f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3456 expref: 25 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.598556:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3456 expref: 24 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.598566:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480091.598569:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480091.598574:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafffa00, rc 0) 00000100:00100000:2.0:1789480091.598664:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11513:x1876405526807936:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 615us (4892us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789480091.598672:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00080000:0.0:1789480091.598988:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480091.602367:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480091.602633:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526808064 00000100:00100000:2.0:1789480091.602647:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526808064 00000100:00100000:2.0:1789480091.602732:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1789480091.602744:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11513:x1876405526808064:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1789480091.602856:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.602878:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.602893:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.602910:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.602930:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.602938:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.603255:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.603264:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.603272:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480091.603470:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603498:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603506:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603514:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603521:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.603532:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603541:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603627:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480091.603632:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.603640:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603648:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe10a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603659:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603665:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603671:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603677:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.603680:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603685:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603691:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804d400) 00010000:00010000:1.0:1789480091.603694:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.603801:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603808:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603825:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603831:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603837:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603842:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.603845:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603850:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603858:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d100) 00010000:00010000:1.0:1789480091.603860:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.603863:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.603869:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe600/0xbb972366037fe118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480091.604265:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11513:x1876405526808064:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1518us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480091.604276:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:2.0:1789480091.659365:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480091.659650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526808320 00000100:00100000:3.0:1789480091.659663:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526808320 00000100:00100000:3.0:1789480091.660228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:3.0:1789480091.660244:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11516:x1876405526808320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480091.660274:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480091.660392:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe11f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f345d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660495:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660513:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660527:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660542:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660566:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660918:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660928:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.660941:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480091.660953:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789480091.661088:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661096:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661103:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661110:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480091.661115:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661124:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661138:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480091.661141:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480091.661148:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661168:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661173:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661184:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661190:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480091.661193:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661199:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661207:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22837b7d00) 00010000:00010000:3.0:1789480091.661209:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480091.661212:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661217:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe12d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661274:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5e00/0xbb972366037fe11f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661333:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.661341:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480091.661343:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480091.661346:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480091.661426:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11516:x1876405526808320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1187us (2076us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789480091.661443:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:3.0:1789480091.668242:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480091.668384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526808448 00000100:00100000:1.0:1789480091.668399:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526808448 00000100:00100000:1.0:1789480091.668477:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:1.0:1789480091.668502:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11516:x1876405526808448:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1789480091.668610:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668632:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668647:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668683:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668691:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668699:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668705:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.668711:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668720:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668736:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:1.0:1789480091.668739:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480091.668746:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.668772:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480091.668872:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11516:x1876405526808448:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 383us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480091.668881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:1.0:1789480091.675876:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480091.675989:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526808704 00000100:00100000:3.0:1789480091.676004:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526808704 00000100:00100000:3.0:1789480091.676167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789480091.676181:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11516:x1876405526808704:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480091.676723:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+27:11516:x1876405526808704:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 543us (861us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789480091.676732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1789480091.730851:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480091.730939:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526808960 00000100:00100000:0.0:1789480091.730955:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526808960 00000100:00100000:0.0:1789480091.731036:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:0.0:1789480091.731049:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+27:11042:x1876405526808960:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480091.731082:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480091.732264:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe149 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3464 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.735932:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.735973:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.735984:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.736043:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.736072:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 28 pid: 5832 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480091.736237:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551971968:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480091.736832:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2282bd1300 going to sleep for 11 seconds 00010000:00010000:0.0:1789480091.744841:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480091.745019:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480091.745221:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876405551971968:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480091.745259:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480091.745348:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809088 00000100:00100000:0.0:1789480091.745357:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809088 00010000:00010000:0.0:1789480091.745403:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 29 pid: 5832 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480091.745459:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1789480091.745474:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+29:2347:x1876405526809088:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480091.745504:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480091.745514:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 29 pid: 5832 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745533:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 29 pid: 5832 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745560:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f345d expref: 29 pid: 5832 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745576:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:0.0:1789480091.745582:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745594:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745602:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480091.745629:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480091.745890:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.745899:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480091.745926:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789480091.747274:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe149 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.747318:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.747327:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:1.0:1789480091.747330:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789480091.747335:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22c2146600, rc 0) 00000100:00100000:1.0:1789480091.747929:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11042:x1876405526808960:12345-192.168.204.54@tcp:101:bash.0 Request processed in 16878us (17088us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789480091.747940:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:0.0:1789480091.748366:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:2347:x1876405526809088:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2161us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480091.748381:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1789480091.753625:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480091.753932:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809344 00000100:00100000:2.0:1789480091.753946:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809344 00000100:00100000:2.0:1789480091.754020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:2.0:1789480091.754033:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11042:x1876405526809344:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1789480091.755071:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.755111:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.755126:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480091.755217:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789480091.755247:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d60f141a reply state 000000000b672e79 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480091.755257:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789480091.755334:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789480091.755491:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11042:x1876405526809344:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1448us (1869us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789480091.755502:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000020:00080000:2.0:1789480091.755509:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789480091.767458:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789480091.767545:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767562:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767571:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767578:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480091.767584:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767593:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767614:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480091.767617:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480091.767631:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.767639:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe15e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480091.768074:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809472 00000100:00100000:2.0:1789480091.768097:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809472 00000100:00100000:2.0:1789480091.768174:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:2.0:1789480091.768187:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11042:x1876405526809472:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480091.768220:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480091.768246:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f346b expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.768348:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe165 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f346b expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.768365:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe165 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f346b expref: 32 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.768661:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480091.768665:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480091.768669:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff600, rc 0) 00000100:00100000:3.0:1789480091.768758:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11042:x1876405526809472:12345-192.168.204.54@tcp:101:bash.0 Request processed in 574us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480091.768955:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:0.0:1789480091.776176:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480091.776779:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809600 00000100:00100000:3.0:1789480091.776794:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809600 00000100:00100000:3.0:1789480091.776908:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1789480091.776922:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bad14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:11042:x1876405526809600:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480091.776949:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480091.776980:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3472 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480091.777017:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94c97, atime: 0x6aa94c96, ctime: 0x6aa94c97, blocks: 0xb 00010000:00010000:3.0:1789480091.777048:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1789480091.777053:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480091.777063:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.777084:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480091.777136:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5e00, rc 0) 00000100:00100000:3.0:1789480091.777217:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bad14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:11042:x1876405526809600:12345-192.168.204.54@tcp:101:bash.0 Request processed in 297us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480091.777225:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00080000:0.0:1789480091.777542:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480091.784995:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480091.785133:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809728 00000100:00100000:1.0:1789480091.785147:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809728 00002000:00010000:1.0:1789480091.785209:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789480091.785216:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2187b07480 with x1876405526809728 ext(0->18446744073709551615) 00002000:00010000:1.0:1789480091.785233:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2187b07480. 00000100:00100000:1.0:1789480091.785273:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789480091.785451:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526809728:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:1.0:1789480091.789846:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789480091.789858:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789480087 -> 1789480092 00002000:00010000:1.0:1789480091.789882:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789480086 -> 1789480086 00002000:00010000:1.0:1789480091.789885:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789480087 -> 1789480092 00002000:00010000:1.0:1789480091.789888:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789480091.790005:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526809728:12345-192.168.204.54@tcp:10:bash.0 Request processed in 4713us (5017us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789480091.790019:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00010000:1.0:1789480091.790027:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789480091.790031:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2187b07480 with x1876405526809728 ext(0->18446744073709551615) 00002000:00010000:1.0:1789480091.790040:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2187b07480. 00000100:00100000:3.0:1789480091.904597:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480091.904834:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526809856 00000100:00100000:1.0:1789480091.904849:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526809856 00000100:00100000:1.0:1789480091.904929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:1.0:1789480091.904941:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11530:x1876405526809856:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:1.0:1789480091.905040:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905073:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905091:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905110:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905118:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905124:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905529:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905541:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905548:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480091.905604:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905618:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905626:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905634:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905641:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.905645:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905654:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905667:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480091.905671:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.905677:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905690:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146a00/0xbb972366037fe173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905706:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905712:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905717:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905722:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.905724:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905729:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905736:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf600) 00010000:00010000:1.0:1789480091.905738:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.905740:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905746:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147c00/0xbb972366037fe17a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905763:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905769:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905782:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905787:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39cc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480091.905790:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905796:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905803:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:1.0:1789480091.905806:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480091.905809:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480091.905815:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037fe181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480091.905926:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11530:x1876405526809856:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 984us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480091.905937:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:0.0:1789480091.990808:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480091.991710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526810112 00000100:00100000:2.0:1789480091.991725:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526810112 00000100:00100000:2.0:1789480091.991833:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1789480091.991847:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+32:11533:x1876405526810112:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480091.991878:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480091.991905:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3479 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992017:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992035:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992049:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992068:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992075:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992082:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992472:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992492:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992499:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480091.992523:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789480091.992651:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992659:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992666:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992673:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480091.992677:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992685:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992698:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480091.992701:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480091.992707:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992713:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe18f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992727:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992733:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992748:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992754:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480091.992757:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992765:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992774:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804dc00) 00010000:00010000:2.0:1789480091.992777:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480091.992780:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992842:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3479 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992859:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3479 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480091.992867:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480091.992869:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789480091.992872:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe000, rc 0) 00000100:00100000:2.0:1789480091.992965:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11533:x1876405526810112:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1121us (2173us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789480091.992983:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1789480092.003038:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.003117:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526810240 00000100:00100000:3.0:1789480092.003132:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526810240 00000100:00100000:3.0:1789480092.003214:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:3.0:1789480092.003227:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11533:x1876405526810240:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789480092.003360:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.003382:0:8260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.003395:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.003440:0:8260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.003460:0:8260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 34 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.003475:0:8260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551972096:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480092.003610:0:8260:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a34480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.007475:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480092.007736:0:8260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8260:1876405551972096:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480092.007747:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526810496 00000100:00100000:2.0:1789480092.007758:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526810496 00010000:00010000:0.0:1789480092.007781:0:8260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.007888:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789480092.007903:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:5588:x1876405526810496:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789480092.008435:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+36:5588:x1876405526810496:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 533us (978us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789480092.008444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1789480092.019444:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480092.019554:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526810624 00000100:00100000:1.0:1789480092.019568:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526810624 00010000:00010000:1.0:1789480092.019627:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 36 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480092.019675:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1789480092.019687:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+36:2347:x1876405526810624:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480092.019707:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480092.019735:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 36 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019755:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 36 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019787:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2146600/0xbb972366037fe150 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3464 expref: 36 pid: 5830 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019806:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:1.0:1789480092.019813:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019823:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019831:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.019871:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480092.019940:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+35:2347:x1876405526810624:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 254us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480092.019948:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:3.0:1789480092.020077:0:8260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.020381:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.020427:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.020436:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.020443:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.021223:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480092.021229:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.021240:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.021257:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480092.021260:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480092.021266:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.022183:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.022969:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11533:x1876405526810240:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 19722us (19924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.023005:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:0.0:1789480092.039367:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.045978:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526810880 00000100:00100000:3.0:1789480092.046002:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526810880 00000100:00100000:0.0:1789480092.046467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480092.046491:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+34:11533:x1876405526810880:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480092.047214:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11533:x1876405526810880:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 731us (7860us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789480092.047224:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480092.189388:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.189495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526811136 00000100:00100000:3.0:1789480092.189509:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526811136 00000100:00100000:3.0:1789480092.189592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:3.0:1789480092.189605:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+35:11544:x1876405526811136:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1789480092.189767:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480092.189798:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3480 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.189900:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.190264:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.190318:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.190338:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.190347:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.190355:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.196767:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe1c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.196821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.196840:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480092.196860:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789480092.197038:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197047:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197065:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197074:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480092.197089:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197099:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197115:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480092.197119:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480092.197127:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197134:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe1b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197163:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197177:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197183:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197189:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480092.197193:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197199:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197209:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22837b7700) 00010000:00010000:3.0:1789480092.197212:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480092.197215:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197221:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe1c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197355:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe1b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3480 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197373:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3480 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.197381:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:3.0:1789480092.197384:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480092.197394:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480092.197504:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+37:11544:x1876405526811136:12345-192.168.204.54@tcp:101:cat.0 Request processed in 7899us (8129us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789480092.197516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:1.0:1789480092.215749:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480092.215942:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526811392 00000100:00100000:2.0:1789480092.215957:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526811392 00000100:00100000:2.0:1789480092.216040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1789480092.216053:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+37:11544:x1876405526811392:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1789480092.216725:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11544:x1876405526811392:12345-192.168.204.54@tcp:35:cat.0 Request processed in 672us (990us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789480092.216735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1789480092.262166:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480092.262318:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526811648 00000100:00100000:2.0:1789480092.262331:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526811648 00000100:00100000:2.0:1789480092.262403:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:2.0:1789480092.262414:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11545:x1876405526811648:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1789480092.262504:0:11710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789480092.262549:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe1c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3480 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262578:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3479 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262614:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f346b expref: 36 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262634:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d22837b7e00) 00010000:00010000:2.0:1789480092.262653:0:11710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480092.262678:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262694:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262706:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262721:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262727:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.262734:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263016:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263025:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263032:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480092.263684:0:11710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789480092.263695:0:11710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385260412158ns, next at 386260409650ns, rc = 0 00010000:00010000:2.0:1789480092.263770:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263782:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263792:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263800:0:11710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263808:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263814:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263851:0:11710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480092.263878:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263883:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263888:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263894:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480092.263906:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263915:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263927:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d200) 00010000:00010000:2.0:1789480092.263930:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789480092.263935:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263943:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe1e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263962:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263970:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263975:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263980:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480092.263982:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263988:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.263995:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480092.263998:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.264010:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.264016:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe1d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480092.264029:0:11710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068b6199b reply state 00000000a9b02339 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.264038:0:11710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480092.264167:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+37:11545:x1876405526811648:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1750us (2020us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789480092.264176:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00010000:00010000:3.0:1789480092.264733:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480092.264742:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.264750:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480092.264754:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.264761:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.264773:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d228804d200) 00010000:00010000:3.0:1789480092.264775:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480092.264779:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.264784:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff400/0xbb972366037fe1ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.264802:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480092.264804:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480092.264805:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480092.270136:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270413:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270423:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270429:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480092.270435:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270444:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270467:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d228804dc00) 00010000:00010000:2.0:1789480092.270471:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.270487:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.270518:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe1dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.359829:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480092.359979:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526811904 00000100:00100000:1.0:1789480092.359993:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526811904 00000100:00100000:1.0:1789480092.360088:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:1.0:1789480092.360102:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+36:11551:x1876405526811904:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789480092.360137:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480092.360172:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c200/0xbb972366037fe1f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3487 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360382:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360402:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360418:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360437:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360445:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.360453:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480092.362375:0:8260:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789480092.363449:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363486:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363504:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363571:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363603:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363611:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363619:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39de00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480092.363625:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363634:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363651:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480092.363654:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480092.363660:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363666:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe1f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480092.363686:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000132487 reply state 000000006f88a7c1 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480092.363697:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789480092.363752:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c200/0xbb972366037fe1f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 39 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363771:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 38 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.363791:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:1.0:1789480092.363794:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480092.363796:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39ce00, rc 0) 00000100:00100000:1.0:1789480092.363919:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+39:11551:x1876405526811904:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3819us (4108us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789480092.363929:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00010000:00010000:3.0:1789480092.383944:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.383969:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.384006:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.384013:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480092.384019:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.384029:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.384051:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf600) 00010000:00010000:3.0:1789480092.384055:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480092.384061:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.384068:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d600/0xbb972366037fe1ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.393719:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480092.395464:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812032 00000100:00100000:2.0:1789480092.395505:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812032 00000100:00100000:2.0:1789480092.395652:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1789480092.395668:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2347:x1876405526812032:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480092.395694:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.395725:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f348e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480092.395762:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480092.395790:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1789480092.395797:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.395809:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.395835:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.395854:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffee00, rc 0) 00000100:00100000:2.0:1789480092.395952:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526812032:12345-192.168.204.54@tcp:101:bash.0 Request processed in 289us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.395961:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00080000:0.0:1789480092.398097:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480092.413947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.414129:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812160 00000100:00100000:3.0:1789480092.414143:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812160 00000100:00100000:3.0:1789480092.414221:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789480092.414235:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:11551:x1876405526812160:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480092.414260:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480092.414325:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3495 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.414384:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.414411:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480092.414416:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480092.414423:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.414484:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.414514:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.414533:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd746300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876405551972224:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480092.415009:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.420689:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd746300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876405551972224:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480092.420750:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.420780:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:3.0:1789480092.420862:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:11551:x1876405526812160:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6630us (6931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.420872:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1789480092.421042:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.421961:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812288 00000100:00100000:3.0:1789480092.421977:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812288 00010000:00010000:2.0:1789480092.422368:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.422455:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1789480092.422480:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526812288:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480092.422516:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480092.422548:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.422566:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.422596:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff8cbee/0xbb972366037fe214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f348e expref: 7 pid: 6687 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.422616:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.422631:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.423365:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.423383:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.423447:0:8453:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.423466:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8453:1876405551972352:192.168.204.54@tcp:105: 00000100:00100000:2.0:1789480092.425513:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480092.445842:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8453:1876405551972352:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480092.445845:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789480092.445877:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480092.445970:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2347:x1876405526812288:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 23503us (24930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.445984:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1789480092.445998:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812544 00000100:00100000:0.0:1789480092.446008:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812544 00000100:00100000:0.0:1789480092.446070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1789480092.446081:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+38:11551:x1876405526812544:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1789480092.446563:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+39:11551:x1876405526812544:12345-192.168.204.54@tcp:35:bash.0 Request processed in 482us (717us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789480092.446591:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1789480092.508499:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551972608:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508672:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551973120:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508740:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789480092.508747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551972480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508805:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551972992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508827:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508857:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551972864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508906:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480092.508923:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551972736:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.508947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.508980:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551973120 00000100:00100000:0.0:1789480092.508989:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551973120 00000100:00100000:0.0:1789480092.509055:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551972864 00000100:00100000:0.0:1789480092.509058:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551972864 00000100:00100000:0.0:1789480092.509083:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789480092.509094:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551973120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509161:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551973120:12345-0@lo:400:kworker.0 Request processed in 68us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509170:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789480092.509190:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789480092.509208:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551972864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509241:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551972864:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509247:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789480092.509267:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551972480 00000100:00100000:0.0:1789480092.509271:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551972480 00000100:00100000:0.0:1789480092.509323:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789480092.509330:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551972480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509360:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3301:x1876405551972480:12345-0@lo:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:0.0:1789480092.509396:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480092.509401:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480092.509433:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551972864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509457:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551972480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509466:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551973120:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551972608 00000100:00100000:0.0:1789480092.509504:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551972608 00000100:00100000:0.0:1789480092.509527:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551972992 00000100:00100000:0.0:1789480092.509530:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551972992 00000100:00100000:0.0:1789480092.509552:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551972736 00000100:00100000:0.0:1789480092.509556:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551972736 00000100:00100000:0.0:1789480092.509571:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789480092.509577:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551972608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509614:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551972608:12345-0@lo:400:kworker.0 Request processed in 37us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509631:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789480092.509644:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789480092.509650:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509680:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551972992:12345-0@lo:400:kworker.0 Request processed in 30us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789480092.509697:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789480092.509703:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551972736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509734:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551972736:12345-0@lo:400:kworker.0 Request processed in 31us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.509740:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1789480092.509754:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480092.509772:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551972736:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509800:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551972992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480092.509812:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551972608:0@lo:400:kworker.0 00010000:00010000:3.0:1789480092.764736:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480092.782257:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480092.782690:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812672 00000100:00100000:0.0:1789480092.782705:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812672 00000100:00100000:0.0:1789480092.782785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:0.0:1789480092.782798:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+39:11567:x1876405526812672:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480092.782832:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480092.782862:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f349c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.782964:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.783004:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.783018:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480092.783067:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789480092.783071:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480092.783092:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.783136:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f349c expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.783162:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f349c expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.783170:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:0.0:1789480092.783173:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480092.783177:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:0.0:1789480092.783271:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+40:11567:x1876405526812672:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 475us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.783279:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:1.0:1789480092.807443:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480092.811020:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526812928 00000100:00100000:2.0:1789480092.811041:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526812928 00000100:00100000:2.0:1789480092.811144:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:2.0:1789480092.811157:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+40:11567:x1876405526812928:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.811185:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.811215:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34a3 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.811376:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.811392:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.811407:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.811421:0:11710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789480092.811603:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34a3 expref: 43 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.811627:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34a3 expref: 42 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.811654:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:2.0:1789480092.811657:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480092.811661:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480092.811750:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+42:11567:x1876405526812928:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 596us (4323us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789480092.811757:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:1.0:1789480092.821087:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480092.821146:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480092.821247:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813312 00000100:00100000:0.0:1789480092.821262:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813312 00000100:00100000:0.0:1789480092.821393:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480092.821405:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+42:2348:x1876405526813312:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480092.821428:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480092.821496:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34a3 expref: 42 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.821522:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:0.0:1789480092.821529:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480092.821600:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+41:2348:x1876405526813312:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 196us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.821608:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1789480092.822162:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813184 00000100:00100000:2.0:1789480092.822170:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813184 00000100:00100000:2.0:1789480092.822224:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:2.0:1789480092.822233:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+41:11567:x1876405526813184:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.822264:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.822311:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe245 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34aa expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.822452:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.822481:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.822496:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.822510:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789480092.822686:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34aa expref: 44 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.822727:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34aa expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.822735:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:2.0:1789480092.822739:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480092.822743:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff800, rc 0) 00000100:00100000:2.0:1789480092.822813:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+43:11567:x1876405526813184:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 581us (1743us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789480092.822821:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:1.0:1789480092.829954:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.834097:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813440 00000100:00100000:3.0:1789480092.834121:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813440 00000100:00100000:3.0:1789480092.834225:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1789480092.834237:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+6:2348:x1876405526813440:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:3.0:1789480092.834319:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.834343:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.834353:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480092.834357:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.834362:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.834405:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.834425:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 6 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.834441:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd746300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876405551973248:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480092.834581:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a4a340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.839183:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd746300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876405551973248:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480092.839227:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480092.841759:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.842158:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813568 00000100:00100000:3.0:1789480092.842172:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813568 00002000:00100000:3.0:1789480092.842240:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d22bb39b480 x1876405526813568/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:243/0 lens 504/0 e 0 to 0 dl 1789480103 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480092.842252:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb39b480 with x1876405526813568 ext(0->8) 00010000:00010000:3.0:1789480092.842262:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 7 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.842334:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 7 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480092.842344:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22bb39b480 00000100:00100000:3.0:1789480092.842378:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1789480092.842388:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526813568:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:3.0:1789480092.843394:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2347:x1876405526813568:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 999us (1639us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789480092.843407:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:3.0:1789480092.843417:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d22bb39b480 x1876405526813568/t4294967308(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:243/0 lens 504/448 e 0 to 0 dl 1789480103 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480092.843427:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb39b480 with x1876405526813568 ext(0->8) 00010000:00010000:3.0:1789480092.843436:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.843476:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480092.843483:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d22bb39b480 00000100:00100000:1.0:1789480092.849590:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.849734:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813696 00000100:00100000:3.0:1789480092.849748:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813696 00010000:00010000:3.0:1789480092.849801:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.849853:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:3.0:1789480092.849865:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526813696:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480092.849885:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789480092.849923:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789480092.849927:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789480092 00002000:00010000:3.0:1789480092.849930:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789480093 00002000:00010000:3.0:1789480092.849932:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789480092 00010000:00010000:3.0:1789480092.849939:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.849959:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.849988:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f3177/0xbb972366037fe21b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3495 expref: 9 pid: 6685 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.850035:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.850040:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.850060:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.850073:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.850386:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480092.850457:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526813696:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 593us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.850477:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00010000:00010000:0.0:1789480092.854396:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854422:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854486:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854496:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854505:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854512:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480092.854517:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854566:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854594:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.854603:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abde309f/0xbb972366037fe25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.854763:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526813440:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 20520us (24817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.854775:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1789480092.859721:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480092.859946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526813952 00000100:00100000:2.0:1789480092.859961:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526813952 00000100:00100000:2.0:1789480092.860040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1789480092.860063:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+43:11567:x1876405526813952:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:2.0:1789480092.860154:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34aa expref: 43 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480092.860504:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789480092.860561:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789480092.860961:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789480092.861026:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.861044:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 47 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.861055:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.861116:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 47 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.861137:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 47 pid: 8260 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.861154:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b06680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876405551973376:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480092.861323:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480092.867507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480092.867863:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814080 00000100:00100000:3.0:1789480092.867875:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814080 00010000:00010000:3.0:1789480092.867940:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 48 pid: 8260 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.867992:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1789480092.868004:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+48:2348:x1876405526814080:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480092.868024:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480092.868033:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 48 pid: 8260 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.868062:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 48 pid: 8260 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.868112:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:3.0:1789480092.868119:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.868131:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.868140:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.868166:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480092.868246:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+48:2348:x1876405526814080:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 243us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.868255:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00010000:00010000:0.0:1789480092.869193:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3487 expref: 47 pid: 8260 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.869218:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b06680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876405551973376:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480092.869246:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.869257:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.869264:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480092.869497:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789480092.869784:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789480092.870217:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd756680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551973504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789480092.870381:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.870558:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd71d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.875383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551973504 00000100:00100000:3.0:1789480092.875404:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551973504 00000100:00100000:3.0:1789480092.875551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480092.875564:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551973504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789480092.875762:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551973504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 200us (5381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.875771:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480092.875858:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd756680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551973504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789480092.876556:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789480092.876667:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd756680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551973632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789480092.876740:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480092.879660:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291764240 going to sleep for 11 seconds 00000100:00100000:2.0:1789480092.879873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551973632 00000100:00100000:2.0:1789480092.879886:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551973632 00000100:00100000:2.0:1789480092.879972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789480092.879984:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876405551973632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789480092.880517:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876405551973632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 534us (3775us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789480092.880537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789480092.880992:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd756680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876405551973632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789480092.881191:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789480092.881263:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881277:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881650:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881681:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480092.881687:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881697:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881718:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:1.0:1789480092.881721:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789480092.881727:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.881734:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffec00/0xbb972366037fe261 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480092.882239:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789480092.885828:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789480092.885859:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385882575546ns, next at 386882570009ns, rc = 0 00000001:00080000:1.0:1789480092.885878:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789480092.886447:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:1.0:1789480092.886454:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480092.886480:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff800/0xbb972366037fe24c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34aa expref: 51 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480092.887438:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+50:11567:x1876405526813952:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 27369us (27723us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789480092.887452:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000020:00080000:1.0:1789480092.887459:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789480092.905008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480092.905208:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814208 00000100:00100000:0.0:1789480092.905223:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814208 00000100:00100000:0.0:1789480092.905347:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:0.0:1789480092.905359:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+50:11567:x1876405526814208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480092.905400:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480092.905431:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fe268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34b1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.905704:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fe268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b1 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.905726:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fe268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b1 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.905754:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480092.905758:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480092.905762:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7200, rc 0) 00000100:00100000:0.0:1789480092.908808:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+51:11567:x1876405526814208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3433us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.908849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:2.0:1789480092.923453:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480092.923702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814464 00000100:00100000:0.0:1789480092.923716:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814464 00000100:00100000:0.0:1789480092.923789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1789480092.923801:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+51:11567:x1876405526814464:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1789480092.924172:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+52:11567:x1876405526814464:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 373us (733us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789480092.924180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1789480093.025175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.026024:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814592 00000100:00100000:3.0:1789480093.026049:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814592 00000100:00100000:3.0:1789480093.026216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:3.0:1789480093.026227:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+52:11577:x1876405526814592:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1789480093.026365:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480093.026916:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480093.027083:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027103:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027208:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027216:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027224:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027371:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027379:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027386:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480093.027638:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027656:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027662:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027687:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027693:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480093.027698:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.027707:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028259:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480093.028264:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480093.028271:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028278:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe26f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028329:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028337:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028342:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028347:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480093.028351:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028368:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028375:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22837b7700) 00010000:00010000:3.0:1789480093.028378:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480093.028381:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.028386:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029035:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029681:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029690:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029696:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480093.029700:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029709:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029735:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480093.029738:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480093.029742:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.029772:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe27d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480093.029936:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+52:11577:x1876405526814592:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 3703us (4769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.029947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:2.0:1789480093.133753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.134176:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814848 00000100:00100000:0.0:1789480093.134190:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814848 00000100:00100000:1.0:1789480093.136522:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:1.0:1789480093.136552:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+52:11580:x1876405526814848:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480093.136585:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.136616:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136726:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136746:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136760:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136778:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136787:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136794:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136969:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136979:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.136987:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.137032:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789480093.137184:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137193:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137201:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137207:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39dc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480093.137212:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137223:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137238:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480093.137242:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.137248:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137255:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe28b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137273:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137280:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137376:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137381:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480093.137384:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137390:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137398:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf200) 00010000:00010000:1.0:1789480093.137401:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.137404:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137410:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137819:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b8 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137838:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b8 expref: 54 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.137846:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:1.0:1789480093.137848:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480093.138123:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39ce00, rc 0) 00000100:00100000:1.0:1789480093.138240:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+54:11580:x1876405526814848:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1703us (4501us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789480093.138263:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1789480093.150670:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.150826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526814976 00000100:00100000:0.0:1789480093.150840:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526814976 00000100:00100000:0.0:1789480093.151081:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1789480093.151096:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+54:11580:x1876405526814976:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1789480093.151200:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.151224:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.151240:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.151276:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153662:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153700:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153708:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.153714:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153726:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153749:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.153752:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480093.153758:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.153766:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037fe2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.155226:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+54:11580:x1876405526814976:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 4116us (4556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.155245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:3.0:1789480093.163240:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.163322:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526815232 00000100:00100000:2.0:1789480093.163336:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526815232 00000100:00100000:2.0:1789480093.163413:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1789480093.163425:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+54:11580:x1876405526815232:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480093.163765:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+55:11580:x1876405526815232:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 340us (539us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789480093.163808:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1789480093.314129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.314413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526815488 00000100:00100000:3.0:1789480093.314429:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526815488 00000100:00100000:3.0:1789480093.314531:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:3.0:1789480093.314544:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+55:11590:x1876405526815488:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480093.314577:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.314581:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480093.314618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f349c expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.314643:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480093.314650:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480093.314667:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe2ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34bf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.314801:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.314816:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.314828:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480093.314860:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789480093.315027:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe2ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34bf expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.315851:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34bf expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.315861:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480093.315865:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480093.315869:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480093.315972:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+56:11590:x1876405526815488:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1429us (1856us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789480093.315982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:2.0:1789480093.319936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.319998:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.320109:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526815616 00000100:00100000:0.0:1789480093.320122:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526815616 00000100:00100000:0.0:1789480093.320224:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1789480093.320236:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+56:2348:x1876405526815616:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480093.320257:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480093.320319:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34bf expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.320367:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.320373:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480093.320442:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+55:2348:x1876405526815616:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 208us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.320450:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480093.322053:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526815872 00000100:00100000:3.0:1789480093.322069:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526815872 00000100:00100000:3.0:1789480093.322156:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:3.0:1789480093.322167:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+55:11590:x1876405526815872:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:3.0:1789480093.322270:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480093.322337:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037fe299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b8 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.322363:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480093.322369:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480093.322680:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.322698:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.322729:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480093.322793:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789480093.322818:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a91285d reply state 00000000eafa050d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480093.322829:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480093.322954:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+57:11590:x1876405526815872:12345-192.168.204.54@tcp:36:bash.0 Request processed in 788us (3033us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789480093.322963:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000020:00080000:3.0:1789480093.322969:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789480093.327354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.327702:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816000 00000100:00100000:1.0:1789480093.327718:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816000 00000100:00100000:1.0:1789480093.327802:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:1.0:1789480093.327814:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:11590:x1876405526816000:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789480093.327853:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.327881:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34c6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.328028:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.328043:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.328052:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.328074:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.328087:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328428:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328438:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328445:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328463:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.328467:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328476:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328493:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.328497:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.328500:0:3284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328508:0:3284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328526:0:3284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328561:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.328570:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe2c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.329663:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.329684:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.329767:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789480093.329772:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480093.329801:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.329853:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.329874:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.329884:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:1.0:1789480093.329887:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480093.329892:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c000, rc 0) 00000100:00100000:1.0:1789480093.329993:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+57:11590:x1876405526816000:12345-192.168.204.54@tcp:101:bash.0 Request processed in 2180us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.330004:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:3.0:1789480093.342526:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.342922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816256 00000100:00100000:2.0:1789480093.342935:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816256 00000100:00100000:2.0:1789480093.343013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1789480093.343027:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+57:11590:x1876405526816256:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1789480093.343619:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+58:11590:x1876405526816256:12345-192.168.204.54@tcp:35:bash.0 Request processed in 594us (1116us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789480093.343629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1789480093.462688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.466741:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816384 00000100:00100000:3.0:1789480093.466762:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816384 00000100:00100000:3.0:1789480093.466927:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:3.0:1789480093.466941:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+58:11596:x1876405526816384:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480093.467136:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.467165:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe2d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467253:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467270:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467311:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480093.467382:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789480093.467386:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480093.467407:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467439:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe2d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34cd expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467473:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34cd expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.467482:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480093.467486:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480093.467491:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480093.467589:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526816384:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 650us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.467597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:0.0:1789480093.474200:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.474991:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816512 00000100:00100000:1.0:1789480093.475006:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816512 00000100:00100000:1.0:1789480093.475095:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:1.0:1789480093.475108:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526816512:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480093.475138:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.475165:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe2e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34d4 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475252:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475345:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475361:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475380:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475388:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475396:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475529:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475539:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475547:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.475594:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789480093.475599:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480093.475623:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475639:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475661:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475669:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475679:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475686:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39dc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480093.475691:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475700:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475714:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480093.475717:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.475723:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475730:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39dc00/0xbb972366037fe2ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475748:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475755:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475761:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475773:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480093.475776:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475782:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475790:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf200) 00010000:00010000:1.0:1789480093.475793:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.475795:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.475801:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe2f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.476616:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe2e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.476641:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 60 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.476650:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:1.0:1789480093.476653:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480093.476657:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c400, rc 0) 00000100:00100000:1.0:1789480093.476792:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11596:x1876405526816512:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1686us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.476801:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1789480093.494529:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.494632:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.494746:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816896 00000100:00100000:1.0:1789480093.494783:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816896 00000100:00100000:1.0:1789480093.494879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1789480093.494891:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11596:x1876405526816896:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480093.494917:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.494946:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34db expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495110:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495127:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495136:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495144:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495189:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495208:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.495225:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551973760:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480093.495403:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.495427:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.495437:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551973888:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480093.495477:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228807f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789480093.502810:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526816640 00000100:00100000:3.0:1789480093.502832:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526816640 00010000:00010000:3.0:1789480093.502892:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 62 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480093.502951:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1789480093.503033:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+62:2347:x1876405526816640:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480093.503064:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480093.503073:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 62 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.503111:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 62 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.503141:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480093.503147:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.503156:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.503164:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480093.503543:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+62:2347:x1876405526816640:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 580us (9029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.503553:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00010000:00010000:2.0:1789480093.507815:0:5832:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.54@tcp) returned -22 from blocking AST (req@0000000016815fb7 x1876405551973760) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.507849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037fe2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34d4 expref: 61 pid: 8260 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.507873:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551973760:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480093.507889:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551973888:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480093.507919:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480093.507925:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.507935:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.508044:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.512565:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.512704:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817024 00000100:00100000:2.0:1789480093.512718:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817024 00010000:00010000:2.0:1789480093.512773:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.512812:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1789480093.512824:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+61:2347:x1876405526817024:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480093.512843:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480093.512852:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.512872:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.512899:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe2d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34c6 expref: 61 pid: 5832 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.512921:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480093.512926:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.512938:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.512947:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.513190:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480093.513269:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+60:2347:x1876405526817024:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 447us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.513278:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00010000:00010000:1.0:1789480093.513818:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.513830:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.513859:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789480093.514234:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39da00/0xbb972366037fe302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.514258:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.514268:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:1.0:1789480093.514271:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789480093.514275:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d200, rc 0) 00000100:00100000:1.0:1789480093.514636:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11596:x1876405526816896:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 19745us (20001us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789480093.514647:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:0.0:1789480093.526722:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.526828:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817280 00000100:00100000:2.0:1789480093.526844:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817280 00000100:00100000:2.0:1789480093.526938:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789480093.526951:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11596:x1876405526817280:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1789480093.526986:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480093.527019:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7200/0xbb972366037fe268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34b1 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.527046:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480093.527052:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480093.527132:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526817280:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.527140:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480093.541883:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.541985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817408 00000100:00100000:3.0:1789480093.542000:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817408 00000100:00100000:3.0:1789480093.542195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1789480093.542210:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526817408:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:3.0:1789480093.542409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.542441:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.542465:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480093.542720:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789480093.542855:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526817408:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 647us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.542864:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:0.0:1789480093.554317:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.554398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.554515:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.554551:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.554589:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817920 00000100:00100000:0.0:1789480093.554603:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817920 00000100:00100000:0.0:1789480093.554669:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817792 00000100:00100000:0.0:1789480093.554672:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817792 00000100:00100000:0.0:1789480093.554710:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1789480093.554721:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526817920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480093.554819:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2346:x1876405526817920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.554828:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1789480093.554849:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:0.0:1789480093.554876:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2346:x1876405526817792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480093.554904:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2346:x1876405526817792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.554910:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00080000:0.0:1789480093.554929:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480093.554984:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.556691:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817536 00000100:00100000:0.0:1789480093.556710:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817536 00000100:00100000:0.0:1789480093.556764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818048 00000100:00100000:0.0:1789480093.556768:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818048 00000100:00100000:0.0:1789480093.556818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:0.0:1789480093.556829:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526818048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480093.556910:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2346:x1876405526818048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 83us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.556918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:0.0:1789480093.556938:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:0.0:1789480093.556944:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+59:11596:x1876405526817536:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480093.556959:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789480093.557364:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789480093.557744:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557836:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557852:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557902:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557923:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557942:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.557946:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480093.557950:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.557960:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6600, rc 0) 00000100:00100000:0.0:1789480093.558020:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11596:x1876405526817536:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1074us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.558028:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1789480093.560358:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526817664 00000100:00100000:3.0:1789480093.560380:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526817664 00000100:00100000:1.0:1789480093.564175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 303 00000100:00100000:1.0:1789480093.564200:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526817664:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480093.564635:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2346:x1876405526817664:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 442us (10233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.564646:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 303 00000040:00080000:2.0:1789480093.594892:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480093.594908:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480093.594958:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789480093.595632:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480093.595824:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b05c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551974016:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480093.596019:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480093.612378:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.612484:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818176 00000100:00100000:3.0:1789480093.612497:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818176 00000100:00100000:3.0:1789480093.612582:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:3.0:1789480093.612596:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526818176:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480093.612645:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480093.612739:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b05c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551974016:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789480093.612791:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11597:x1876405526818176:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 198us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.612800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:1.0:1789480093.627430:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.629404:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818304 00000100:00100000:0.0:1789480093.629426:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818304 00000100:00100000:0.0:1789480093.629541:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1789480093.629555:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11597:x1876405526818304:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480093.629670:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.629694:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.629711:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635359:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635385:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635403:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635442:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635462:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635471:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480093.635523:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789480093.635528:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480093.635543:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635556:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635562:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635569:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635596:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.635602:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635612:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635626:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480093.635629:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.635634:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635640:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037fe325 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635658:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635664:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635669:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635673:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.635676:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635681:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635698:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d2290ce3600) 00010000:00010000:0.0:1789480093.635700:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.635703:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635709:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe32c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635726:0:8260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635731:0:8260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635736:0:8260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635742:0:8260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.635745:0:8260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635750:0:8260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635757:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.635759:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.635762:0:8260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.635768:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.635885:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11597:x1876405526818304:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 6327us (8468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.635896:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:1.0:1789480093.638541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.640556:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818560 00000100:00100000:0.0:1789480093.640572:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818560 00000100:00100000:0.0:1789480093.640639:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:0.0:1789480093.640650:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+60:11597:x1876405526818560:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480093.640680:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480093.640721:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe33a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34e9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.640825:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.640978:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.640992:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480093.641005:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789480093.641110:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641119:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641189:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641216:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.641221:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641230:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641245:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480093.641248:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789480093.641254:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641260:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641843:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe33a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e9 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641966:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:0.0:1789480093.641969:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480093.641975:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7800/0xbb972366037fe33a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e9 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.641988:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7800, rc 0) 00000100:00100000:0.0:1789480093.642067:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526818560:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1418us (3541us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1789480093.642075:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:1.0:1789480093.651977:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.655140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818688 00000100:00100000:3.0:1789480093.655164:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818688 00000100:00100000:3.0:1789480093.655307:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:3.0:1789480093.655322:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526818688:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480093.655402:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480093.655558:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526818688:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 240us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.655566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:0.0:1789480093.672015:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.672331:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526818944 00000100:00100000:1.0:1789480093.672346:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526818944 00000100:00100000:1.0:1789480093.672428:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:1.0:1789480093.672441:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526818944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480093.672480:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.672483:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789480093.672531:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34cd expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.672555:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480093.672562:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480093.672581:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe34f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34f0 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480093.673555:0:8260:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789480093.673830:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.673848:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.673880:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.673968:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe34f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f0 expref: 63 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.673991:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f0 expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.673999:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:1.0:1789480093.674003:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480093.674006:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39de00, rc 0) 00000100:00100000:1.0:1789480093.675540:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+62:11597:x1876405526818944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3087us (3526us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789480093.675556:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:2.0:1789480093.685581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.685712:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526819200 00000100:00100000:0.0:1789480093.685727:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526819200 00000100:00100000:0.0:1789480093.685812:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1789480093.685825:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+62:11597:x1876405526819200:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480093.686089:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480093.686126:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39de00/0xbb972366037fe356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f0 expref: 62 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686153:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22abedf200) 00010000:00010000:0.0:1789480093.686166:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480093.686193:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686210:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686221:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686235:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686242:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686249:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686457:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686477:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686484:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686492:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.686498:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686507:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686516:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:0.0:1789480093.686519:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.686523:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686529:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe364 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686541:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686546:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686552:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686557:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480093.686565:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686572:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686580:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfc1c1e7f (ffff8d2290ce3600) 00010000:00010000:0.0:1789480093.686583:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.686586:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.686592:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7e00/0xbb972366037fe36b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfc1c1e7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.688718:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526819200:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2876us (3135us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480093.688737:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:0.0:1789480093.694981:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.695185:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526819328 00000100:00100000:3.0:1789480093.695200:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526819328 00000100:00100000:3.0:1789480093.695276:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1789480093.695327:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+61:11597:x1876405526819328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480093.695355:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.695415:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe372 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695476:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695495:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695510:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695637:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695660:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.695670:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:3.0:1789480093.695674:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480093.695679:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:3.0:1789480093.695761:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+62:11597:x1876405526819328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 438us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.695769:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:1.0:1789480093.706957:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.709800:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526819584 00000100:00100000:0.0:1789480093.709822:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526819584 00000100:00100000:2.0:1789480093.715059:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:2.0:1789480093.715081:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+62:11597:x1876405526819584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480093.715208:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.715230:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.715243:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480093.717705:0:8260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789480093.717732:0:8260:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386714448273ns, next at 387714443252ns, rc = 0 00000004:00010000:2.0:1789480093.717884:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003ff5bc3 reply state 00000000299bc380 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.717899:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480093.719310:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+64:11597:x1876405526819584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 4202us (12335us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789480093.719324:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1789480093.729685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480093.730108:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526819712 00000100:00100000:0.0:1789480093.730124:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526819712 00000100:00100000:0.0:1789480093.730212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:0.0:1789480093.730224:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+64:11597:x1876405526819712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480093.730260:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480093.730327:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f34fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.730419:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 65 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.730476:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 65 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.730502:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:0.0:1789480093.730506:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480093.730622:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6e00, rc 0) 00000100:00100000:0.0:1789480093.730715:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+65:11597:x1876405526819712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 493us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.730725:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00010000:00010000:3.0:1789480093.734280:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734322:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734331:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734357:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480093.734364:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734375:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734400:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:3.0:1789480093.734403:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480093.734409:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.734416:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe800/0xbb972366037fe380 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.734954:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.735496:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526819840 00000100:00100000:3.0:1789480093.735519:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526819840 00000100:00100000:3.0:1789480093.735584:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1789480093.735596:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2348:x1876405526819840:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789480093.736016:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2348:x1876405526819840:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 420us (1066us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789480093.737622:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789480093.739397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.739500:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820096 00000100:00100000:3.0:1789480093.739512:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820096 00000100:00100000:3.0:1789480093.739644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1789480093.739657:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+64:11597:x1876405526820096:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480093.740238:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+65:11597:x1876405526820096:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 581us (852us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789480093.740267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1789480093.752807:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.756736:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820352 00000100:00100000:2.0:1789480093.756758:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820352 00000100:00100000:2.0:1789480093.756936:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:2.0:1789480093.756950:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+65:11597:x1876405526820352:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789480093.757131:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+65:11597:x1876405526820352:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 184us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.757138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:0.0:1789480093.762471:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.766555:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820480 00000100:00100000:1.0:1789480093.766580:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820480 00000100:00100000:1.0:1789480093.766684:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:1.0:1789480093.766695:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+65:11597:x1876405526820480:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480093.766726:0:11710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.766757:0:11710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe38e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3505 expref: -99 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.766890:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.770514:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.770549:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.770619:0:11710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789480093.770648:0:11710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.770705:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe38e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3505 expref: 67 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.770730:0:11710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3505 expref: 66 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.770740:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:1.0:1789480093.770743:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789480093.770748:0:11710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d400, rc 0) 00000100:00100000:1.0:1789480093.770853:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+66:11597:x1876405526820480:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4158us (8405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.770865:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:3.0:1789480093.778532:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.778781:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820608 00000100:00100000:2.0:1789480093.778794:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820608 00000100:00100000:2.0:1789480093.778872:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1789480093.778884:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+10:2348:x1876405526820608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480093.778922:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480093.778951:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f350c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480093.778989:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c9d, blocks: 0x1 00010000:00010000:2.0:1789480093.779017:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1789480093.779022:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480093.779228:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.779253:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.779271:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff400, rc 0) 00000100:00100000:2.0:1789480093.779394:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2348:x1876405526820608:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 512us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.779402:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:0.0:1789480093.788204:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480093.794374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.794698:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820864 00000100:00100000:1.0:1789480093.794712:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820864 00000100:00100000:1.0:1789480093.794789:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1789480093.794821:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+66:11597:x1876405526820864:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480093.794987:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+66:11597:x1876405526820864:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 169us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.794995:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1789480093.818492:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480093.818700:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526820992 00000100:00100000:2.0:1789480093.818714:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526820992 00000100:00100000:2.0:1789480093.818789:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1789480093.818801:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+11:11597:x1876405526820992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480093.818824:0:8279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480093.818868:0:8279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3513 expref: -99 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.818922:0:8279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.818933:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480093.818938:0:8279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480093.818945:0:8279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 12 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.818990:0:8279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.819009:0:8279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 12 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.819037:0:8279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8279:1876405551974144:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480093.819175:0:8279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789480093.822472:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.822889:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821120 00000100:00100000:1.0:1789480093.822913:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821120 00010000:00010000:1.0:1789480093.822971:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 13 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.823037:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789480093.823050:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2348:x1876405526821120:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480093.823075:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480093.823108:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 13 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.823130:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 13 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.823164:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480093.823170:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480093.823183:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 13 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.823196:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 13 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.823266:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 13 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.823332:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551974272:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480093.823459:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092a900 going to sleep for 11 seconds 00010000:00010000:2.0:1789480093.824026:0:8279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe39c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f350c expref: 13 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.824049:0:8279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8279:1876405551974144:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480093.824086:0:8279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 12 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.824121:0:8279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480093.824172:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+12:11597:x1876405526820992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5372us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.824181:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1789480093.827710:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876405551974272:192.168.204.54@tcp:105: 00010000:00010000:2.0:1789480093.827754:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480093.827840:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2348:x1876405526821120:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 4791us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.827854:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1789480093.834393:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.834524:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821248 00000100:00100000:1.0:1789480093.834538:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821248 00002000:00100000:1.0:1789480093.834614:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d22bb2fc380 x1876405526821248/t0(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:244/0 lens 504/0 e 0 to 0 dl 1789480104 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480093.834628:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb2fc380 with x1876405526821248 ext(0->12) 00002000:00010000:1.0:1789480093.834637:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bb2fc380 00000100:00100000:1.0:1789480093.834675:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789480093.834688:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+11:2347:x1876405526821248:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789480093.835830:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2347:x1876405526821248:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1133us (1442us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789480093.835846:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00002000:00100000:1.0:1789480093.835860:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d22bb2fc380 x1876405526821248/t4294967321(0) o4->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:244/0 lens 504/448 e 0 to 0 dl 1789480104 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480093.835872:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bb2fc380 with x1876405526821248 ext(0->12) 00002000:00010000:1.0:1789480093.835878:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bb2fc380 00000100:00100000:0.0:1789480093.846179:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480093.849221:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821376 00000100:00100000:1.0:1789480093.849243:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821376 00000100:00100000:1.0:1789480093.849631:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:1.0:1789480093.849663:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+66:11597:x1876405526821376:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789480093.944242:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+66:11597:x1876405526821376:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 94564us (98061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.944260:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1789480093.947540:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000001:00080000:0.0:1789480093.947717:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:0.0:1789480093.947744:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d229154f9c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789480093.947749:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d229154f000 00000020:00080000:0.0:1789480093.947754:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22ba67e000 00000020:00080000:0.0:1789480093.947787:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2283776480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789480093.947791:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2283776cc0 00000020:00080000:0.0:1789480093.947794:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bd76ec00 00000001:00080000:0.0:1789480093.947809:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:0.0:1789480093.947822:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789480093.947867:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1789480093.947871:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789480093.947913:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1789480093.947956:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000100:00100000:0.0:1789480093.948406:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551974528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789480093.948497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480093.948590:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480093.948598:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551974400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789480093.948626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480093.948656:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551974656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789480093.948681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480093.948720:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821504 00000100:00100000:0.0:1789480093.948728:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821504 00000100:00100000:0.0:1789480093.948780:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551974528 00000100:00100000:0.0:1789480093.948784:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551974528 00000100:00100000:0.0:1789480093.948797:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551974400 00000100:00100000:0.0:1789480093.948799:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551974400 00000100:00100000:0.0:1789480093.948809:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551974656 00000100:00100000:0.0:1789480093.948811:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551974656 00000100:00100000:0.0:1789480093.948825:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1789480093.948834:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2348:x1876405526821504:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789480093.949243:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480093.949255:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551974528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789480093.949276:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789480093.949334:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.949362:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 13 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.949374:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789480093.949378:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480093.949383:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.949425:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 13 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.949473:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 13 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.949489:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551974784:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480093.949613:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789480093.949624:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1876405551974400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789480093.949641:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1789480093.949679:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94c9c, atime: 0x6aa94c9d, ctime: 0x6aa94c9c, blocks: 0x1 00010000:00010000:0.0:1789480093.949686:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.949710:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1789480093.949713:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480093.949721:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.949740:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.949752:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.949761:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.949784:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480093.950243:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2185f1e000 going to sleep for 11 seconds 00000020:00080000:3.0:1789480093.950355:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789480093.950628:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1789480093.950688:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480093.950698:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.950710:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480093.950716:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.950728:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.950750:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.950758:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab4822e/0xbb972366037fe3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.950802:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480093.950804:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480093.950806:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480093.956467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3299:x1876405551974400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6834us (7829us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789480093.956484:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1789480093.956632:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bb2fdc00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789480093.956641:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551974400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789480093.956983:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789480093.957003:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876405551974656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789480093.957275:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789480093.957467:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789480094 00002000:00010000:0.0:1789480093.957472:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789480093.957474:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789480093 -> 1789480094 00002000:00010000:0.0:1789480093.957477:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789480093.957667:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3300:x1876405551974656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 673us (8983us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789480093.957677:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:0.0:1789480093.957836:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bfd8c700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789480093.957843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551974656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789480093.958864:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480093.959755:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876405551974784:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480093.959794:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.960141:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821632 00000100:00100000:0.0:1789480093.960152:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821632 00010000:00010000:0.0:1789480093.960204:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 14 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.960460:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1789480093.960471:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+14:2347:x1876405526821632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480093.960490:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480093.960496:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 14 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.960585:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 14 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.960615:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcfde25/0xbb972366037fe16c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3472 expref: 14 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.960631:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480093.960636:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480093.960642:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.960653:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.960752:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480093.960829:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+13:2347:x1876405526821632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 359us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.960837:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:3.0:1789480093.968003:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.968039:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.968055:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.968065:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.968133:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789480093.969341:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1876405551974528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20082us (20835us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789480093.969355:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789480093.969458:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bfd8d180/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789480093.969468:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551974528:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789480093.969632:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480093.969644:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.969658:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480093.969664:0:11176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.969677:0:11176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.969701:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.969709:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe3aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.969736:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480093.969738:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480093.969740:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789480094.010493:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1789480094.010526:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1789480094.011325:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526821504:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 62481us (63791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.011340:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1789480094.016122:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480094.016806:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526821888 00000100:00100000:0.0:1789480094.016822:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526821888 00000100:00100000:0.0:1789480094.016929:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:0.0:1789480094.016942:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11597:x1876405526821888:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480094.017019:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480094.017059:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037fe395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3505 expref: 20 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.017084:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:0.0:1789480094.017090:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480094.017131:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.017148:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.017159:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480094.017550:0:8260:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024a1714f reply state 000000006bdf81ab transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.017576:0:8260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480094.017729:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+21:11597:x1876405526821888:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 788us (1620us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789480094.017738:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00010000:00010000:2.0:1789480094.021380:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021405:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021415:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021422:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480094.021429:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021448:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021472:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:2.0:1789480094.021475:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480094.021482:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.021489:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6800/0xbb972366037fe3b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.025147:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480094.026068:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822016 00000100:00100000:2.0:1789480094.026085:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822016 00000100:00100000:2.0:1789480094.026182:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1789480094.026196:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526822016:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789480094.027236:0:12025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789480094.027244:0:12025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789480094 -> 1789480093 00002000:00010000:2.0:1789480094.027247:0:12025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789480093 00002000:00010000:2.0:1789480094.027249:0:12025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789480094 -> 1789480093 00002000:00010000:2.0:1789480094.027250:0:12025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789480094.027673:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526822016:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 1473us (2535us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789480094.027685:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1789480094.033747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480094.033872:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822272 00000100:00100000:2.0:1789480094.033886:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822272 00000100:00100000:1.0:1789480094.034064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:1.0:1789480094.034080:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+20:11597:x1876405526822272:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789480094.034191:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.034214:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.034224:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.034272:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.034341:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 20 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.034380:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551974912:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480094.034526:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480094.039218:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551974912:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480094.039263:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.041830:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480094.042112:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822400 00000100:00100000:3.0:1789480094.042126:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822400 00010000:00010000:3.0:1789480094.042184:0:8453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 21 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.042244:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1789480094.042256:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+21:2347:x1876405526822400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480094.042277:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480094.042330:0:8453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 21 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042348:0:8453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 21 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042375:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34f7 expref: 21 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042396:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:3.0:1789480094.042403:0:8453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042415:0:8453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042424:0:8453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.042492:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480094.042563:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+20:2347:x1876405526822400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 308us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.042571:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00010000:00010000:1.0:1789480094.042755:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042766:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042811:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042819:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042827:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042834:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480094.042840:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042850:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:1.0:1789480094.042872:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789480094.042878:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.042885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c800/0xbb972366037fe3bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.042934:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11597:x1876405526822272:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 8859us (9204us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789480094.042944:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1789480094.046741:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480094.046922:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822528 00000100:00100000:1.0:1789480094.046937:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822528 00000100:00100000:1.0:1789480094.047030:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1789480094.047045:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526822528:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789480094.047106:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.047131:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 8 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.047140:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789480094.047144:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480094.047149:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.047191:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 8 pid: 8279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.047232:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 8 pid: 8279 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.047251:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876405551975040:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480094.047378:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480094.052182:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876405551975040:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480094.052237:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.055089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480094.055222:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822656 00000100:00100000:2.0:1789480094.055236:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822656 00010000:00010000:2.0:1789480094.055334:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 9 pid: 8279 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480094.055379:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:2.0:1789480094.055391:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+9:2346:x1876405526822656:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480094.055412:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480094.055460:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 9 pid: 8279 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.055517:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 9 pid: 8279 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.055552:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e5c151/0xbb972366037fe3a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3513 expref: 9 pid: 8279 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.055577:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480094.055582:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480094.055589:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.055600:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.055643:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480094.055731:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2346:x1876405526822656:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 342us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.055740:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:1.0:1789480094.055825:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055837:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055876:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055886:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055895:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055917:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480094.055922:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055933:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055947:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.055955:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a905c56/0xbb972366037fe3c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.056013:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526822528:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 8972us (9288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.056021:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1789480094.059879:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480094.059998:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526822912 00000100:00100000:3.0:1789480094.060012:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526822912 00000100:00100000:3.0:1789480094.060101:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:3.0:1789480094.060113:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11597:x1876405526822912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789480094.060228:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060251:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060266:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060600:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060612:0:11710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060621:0:11710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060666:0:11710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.060708:0:11710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 20 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.060726:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd746680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551975168:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480094.060856:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab98b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480094.069865:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd746680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551975168:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480094.069916:0:11710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.075402:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480094.075581:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526823040 00000100:00100000:1.0:1789480094.075597:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526823040 00010000:00010000:1.0:1789480094.075666:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 21 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.075745:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1789480094.075758:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+21:2347:x1876405526823040:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480094.075776:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480094.075785:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 21 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075803:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 21 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075831:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6e00/0xbb972366037fe387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34fe expref: 21 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075855:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:1.0:1789480094.075862:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075873:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075882:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.075926:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480094.076013:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+20:2347:x1876405526823040:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 257us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.076022:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00010000:00010000:3.0:1789480094.076984:0:11710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.077000:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480094.077319:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789480094.077671:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789480094.078852:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789480094.078993:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd746680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551975296:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789480094.079094:0:11710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.079143:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22925a99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480094.080096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551975296 00000100:00100000:2.0:1789480094.080110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551975296 00000100:00100000:2.0:1789480094.080219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480094.080232:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11710:x1876405551975296:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789480094.080431:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11710:x1876405551975296:12345-0@lo:1000:mdt00_004.0 Request processed in 201us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.080449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789480094.080661:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480094.080870:0:11710:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1789480094.080886:0:11710:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1789480094.080919:0:11710:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d22bfd8c700 x1876405551974656/t4294967322(4294967322) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789480109 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480094.080935:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd746680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551975296:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1789480094.081988:0:11710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789480094.082372:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a4975180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551975424:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789480094.082469:0:11710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.082517:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480094.083410:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551975424 00000100:00100000:3.0:1789480094.083423:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551975424 00000100:00100000:3.0:1789480094.083495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480094.083518:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11710:x1876405551975424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789480094.084446:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:11710:x1876405551975424:12345-0@lo:1000:mdt00_004.0 Request processed in 918us (1964us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789480094.084459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480094.085261:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a4975180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11710:1876405551975424:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789480094.085362:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085376:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085385:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085393:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480094.085400:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085411:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085433:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d22837b7700) 00010000:00010000:0.0:1789480094.085448:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480094.085455:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085490:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4600/0xbb972366037fe3d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085651:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085659:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085665:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085671:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480094.085675:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.085680:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.086145:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:0.0:1789480094.086150:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480094.086162:0:11710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.086176:0:11710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.086185:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.086259:0:11710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.086278:0:11710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551975552:192.168.204.54@tcp:105: 00000100:00100000:0.0:1789480094.087189:0:11710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480094.090511:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480094.090617:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526823168 00000100:00100000:2.0:1789480094.090629:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526823168 00000100:00100000:2.0:1789480094.090697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1789480094.090709:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11596:x1876405526823168:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:2.0:1789480094.090896:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+24:11596:x1876405526823168:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 189us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.090905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1789480094.091526:0:11710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11710:1876405551975552:192.168.204.54@tcp:105: 00010000:00010000:3.0:1789480094.091564:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091597:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe317 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091639:0:11710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091657:0:11710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091670:0:11710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091681:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091689:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091696:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091702:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480094.091708:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091717:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091731:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480094.091735:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480094.091740:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091752:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe3db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091768:0:11710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091774:0:11710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091780:0:11710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091784:0:11710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480094.091787:0:11710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091792:0:11710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091799:0:11710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480094.091802:0:11710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480094.091804:0:11710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.091810:0:11710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe3cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.092654:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11597:x1876405526822912:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 32536us (32782us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789480094.092667:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000020:00080000:3.0:1789480094.092684:0:11710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789480094.093208:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480094.093215:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480094.094091:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789480094.094107:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480094.099013:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480094.099081:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480094.099265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526823424 00000100:00100000:1.0:1789480094.099278:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526823424 00000100:00100000:1.0:1789480094.099396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:1.0:1789480094.099409:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11596:x1876405526823424:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:1.0:1789480094.100575:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789480094.100884:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11596:x1876405526823424:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1472us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.100896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1789480094.103995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526823680 00000100:00100000:2.0:1789480094.104018:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526823680 00000100:00100000:2.0:1789480094.104127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1789480094.104141:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286eae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+23:11597:x1876405526823680:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789480094.105072:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789480094.105200:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789480094.105262:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105313:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105329:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105340:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105347:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105362:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.105389:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480094.105525:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286eae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11597:x1876405526823680:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1383us (6438us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789480094.105536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:2.0:1789480094.105542:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789480094.105735:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480094.105745:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.105753:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480094.105758:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.105769:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.105785:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d228804d600) 00010000:00010000:0.0:1789480094.105789:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789480094.105796:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.105803:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffee00/0xbb972366037fe3e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.105824:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480094.105833:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480094.105835:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480094.170768:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480094.175069:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526823808 00000100:00100000:1.0:1789480094.175090:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526823808 00000100:00100000:1.0:1789480094.175185:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:1.0:1789480094.175198:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+25:11599:x1876405526823808:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480094.175233:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480094.175264:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe3e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f351a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175388:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175408:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175424:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175453:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.175495:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.177407:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.177455:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.177465:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.177520:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.177544:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 26 pid: 5832 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.177563:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551975680:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480094.177715:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480094.185136:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480094.185319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824064 00000100:00100000:1.0:1789480094.185335:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824064 00000100:00100000:1.0:1789480094.185424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1789480094.185447:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+27:5589:x1876405526824064:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480094.185831:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:5589:x1876405526824064:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 394us (707us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789480094.185840:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1789480094.186055:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876405551975680:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480094.186167:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.191795:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480094.191978:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824192 00000100:00100000:2.0:1789480094.191992:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824192 00010000:00010000:2.0:1789480094.192051:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 28 pid: 5832 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480094.192184:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1789480094.192197:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:2347:x1876405526824192:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480094.192219:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480094.192228:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 28 pid: 5832 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192249:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 28 pid: 5832 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192331:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d200/0xbb972366037fe309 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34db expref: 28 pid: 5832 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192379:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480094.192386:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192411:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192422:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.192480:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480094.192541:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192554:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480094.192628:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789480094.192634:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480094.192662:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192679:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192702:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192710:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192718:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192725:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480094.192730:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192739:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192749:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480094.192752:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480094.192764:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192771:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c600/0xbb972366037fe3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192785:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192792:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192798:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192803:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480094.192806:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192812:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d22abedf900) 00010000:00010000:3.0:1789480094.192821:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480094.192823:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192828:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d800/0xbb972366037fe3f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192871:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe3e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f351a expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192901:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f351a expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.192909:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480094.192912:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480094.192915:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39ca00, rc 0) 00000100:00100000:2.0:1789480094.194042:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+27:2347:x1876405526824192:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1835us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.194057:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1789480094.197644:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11599:x1876405526823808:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 22421us (27352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.197666:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000001:00080000:2.0:1789480094.608191:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789480094.608220:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1789480094.812334:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480095.066623:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480095.066651:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551975808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480095.066729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480095.066832:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551975808 00000100:00100000:1.0:1789480095.066841:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551975808 00000100:00100000:1.0:1789480095.066905:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789480095.066916:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551975808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480095.066960:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480095.067009:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551975808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480095.067016:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789480095.067141:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480095.067166:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789480095.067172:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789480095.067192:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bb2fdc00, transno 4294967310 00000100:00100000:3.0:1789480095.067218:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551975808:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789480095.131765:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480095.131774:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480095.131812:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789480095.131818:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480095.131951:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551975936:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480095.132101:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d228343bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480095.149169:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876405551975936:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480095.152578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480095.152796:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824320 00000100:00100000:0.0:1789480095.152807:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824320 00000100:00100000:0.0:1789480095.152884:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:0.0:1789480095.152896:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11610:x1876405526824320:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789480095.152933:0:11710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480095.153053:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11610:x1876405526824320:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.153060:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00080000:1.0:1789480095.153925:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480095.161450:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480095.161741:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824576 00000100:00100000:3.0:1789480095.161750:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824576 00000100:00100000:3.0:1789480095.161823:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:3.0:1789480095.161834:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+26:11610:x1876405526824576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480095.161854:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480095.161876:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe405 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3521 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.161986:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe40c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.164174:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.164208:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480095.164232:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789480095.164442:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe405 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3521 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.164463:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3521 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.164473:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480095.164476:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480095.164480:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5600, rc 0) 00000100:00100000:3.0:1789480095.164790:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11610:x1876405526824576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2957us (3349us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789480095.164800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1789480095.176766:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480095.178757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824832 00000100:00100000:2.0:1789480095.178772:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824832 00000100:00100000:2.0:1789480095.178834:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:2.0:1789480095.178845:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11610:x1876405526824832:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789480095.178927:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.178945:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.178957:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179157:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179165:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179172:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179178:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480095.179182:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179189:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179201:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480095.179204:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480095.179209:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.179216:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe000/0xbb972366037fe41a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480095.179511:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480095.179516:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480095.181142:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789480095.181160:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480095.184854:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11610:x1876405526824832:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 5999us (8087us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789480095.184869:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:1.0:1789480095.188318:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480095.188368:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526824960 00000100:00100000:2.0:1789480095.188380:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526824960 00000100:00100000:2.0:1789480095.188614:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789480095.188637:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+29:2348:x1876405526824960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480095.188656:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480095.188681:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5600/0xbb972366037fe40c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3521 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.188702:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:2.0:1789480095.188706:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480095.188757:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+28:2348:x1876405526824960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 123us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480095.188765:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789480095.198059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480095.201348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825216 00000100:00100000:1.0:1789480095.201362:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825216 00000100:00100000:1.0:1789480095.201632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1789480095.201647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+28:11610:x1876405526825216:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789480095.201923:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11610:x1876405526825216:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 279us (3875us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789480095.201931:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000040:00080000:2.0:1789480095.261140:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480095.261150:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480095.261200:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789480095.261208:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789480095.585438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480095.585493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825472 00000100:00100000:1.0:1789480095.585503:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825472 00000100:00100000:1.0:1789480095.585563:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:1.0:1789480095.585574:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+29:11623:x1876405526825472:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480095.585601:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480095.585622:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3528 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.585744:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe428 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.585761:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe428 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.585773:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe428 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480095.585783:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789480095.585917:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037fe421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3528 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.585935:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3528 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.585944:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:1.0:1789480095.585947:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789480095.585951:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d000, rc 0) 00000100:00100000:1.0:1789480095.586023:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11623:x1876405526825472:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 450us (592us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789480095.586032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:3.0:1789480095.591269:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551976064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480095.591388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480095.591621:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976064 00000100:00100000:0.0:1789480095.591631:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976064 00000100:00100000:0.0:1789480095.591678:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789480095.591687:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876405551976064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480095.591725:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480095.591771:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876405551976064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.591786:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789480095.591901:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551976064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480095.592436:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480095.592592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825600 00000100:00100000:3.0:1789480095.592599:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825600 00000100:00100000:3.0:1789480095.592678:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:3.0:1789480095.592688:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11623:x1876405526825600:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1789480095.592754:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592771:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592785:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592812:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592819:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592826:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592832:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480095.592837:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592844:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480095.592874:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480095.592880:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.592886:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5400/0xbb972366037fe436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480095.592957:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+31:11623:x1876405526825600:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 269us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.592964:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:1.0:1789480095.689129:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480095.689331:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825728 00000100:00100000:0.0:1789480095.689342:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825728 00000100:00100000:0.0:1789480095.689477:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1789480095.689487:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2347:x1876405526825728:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:0.0:1789480095.689506:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480095.689531:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d82a0324/0xbb972366037fe43d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f352f expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789480095.689560:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa94c9d, atime: 0x6aa94c9d, ctime: 0x6aa94c9d, blocks: 0xb 00010000:00010000:0.0:1789480095.689581:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1789480095.689586:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480095.689595:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d82a0324/0xbb972366037fe43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f352f expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.689615:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d82a0324/0xbb972366037fe43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f352f expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.689630:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480095.689695:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2347:x1876405526825728:12345-192.168.204.54@tcp:101:cat.0 Request processed in 209us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.689702:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00080000:1.0:1789480095.697731:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480095.700722:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480095.700819:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825856 00000100:00100000:3.0:1789480095.700830:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825856 00002000:00100000:3.0:1789480095.700887:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d22bd7a9f80 x1876405526825856/t0(0) o3->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:246/0 lens 488/0 e 0 to 0 dl 1789480106 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480095.700900:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd7a9f80 with x1876405526825856 ext(0->4095) 00002000:00010000:3.0:1789480095.700906:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd7a9f80 00000100:00100000:3.0:1789480095.700998:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1789480095.701008:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2346:x1876405526825856:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:3.0:1789480095.701245:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2346:x1876405526825856:12345-192.168.204.54@tcp:3:cat.0 Request processed in 237us (531us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789480095.701253:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00002000:00100000:3.0:1789480095.701261:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d22bd7a9f80 x1876405526825856/t0(0) o3->f712dbb2-3172-402a-b822-94513dd5b6e3@192.168.204.54@tcp:246/0 lens 488/4536 e 0 to 0 dl 1789480106 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480095.701269:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d22bd7a9f80 with x1876405526825856 ext(0->4095) 00002000:00010000:3.0:1789480095.701331:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d22bd7a9f80 00010000:00010000:0.0:1789480095.837664:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480096.220423:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480096.220433:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480096.220511:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789480096.220518:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789480096.861023:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480097.641714:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551976576:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.641796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.641877:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480097.641887:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551976192:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.641925:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.641972:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551976704:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.642006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.642045:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551976320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.642075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.642100:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551976832:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.642128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.642172:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480097.642181:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551976448:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.642215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.642259:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976576 00000100:00100000:2.0:1789480097.642268:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976576 00000100:00100000:2.0:1789480097.642352:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976832 00000100:00100000:2.0:1789480097.642357:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976832 00000100:00100000:1.0:1789480097.642696:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976704 00000100:00100000:1.0:1789480097.642702:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976704 00000100:00100000:1.0:1789480097.642755:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976320 00000100:00100000:1.0:1789480097.642760:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976320 00000100:00100000:1.0:1789480097.642789:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976448 00000100:00100000:1.0:1789480097.642793:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976448 00000100:00100000:1.0:1789480097.642822:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789480097.642833:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.642905:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551976704:12345-0@lo:400:kworker.0 Request processed in 74us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480097.642914:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789480097.642942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789480097.642952:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551976320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643000:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551976320:12345-0@lo:400:kworker.0 Request processed in 50us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480097.643009:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789480097.643033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789480097.643042:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551976448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643080:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a48dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551976448:12345-0@lo:400:kworker.0 Request processed in 39us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480097.643088:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1789480097.643118:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480097.643124:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480097.643128:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480097.643148:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789480097.643158:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1876405551976576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643200:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1876405551976576:12345-0@lo:400:kworker.0 Request processed in 44us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480097.643207:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789480097.643276:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551976704:0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643306:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551976576:0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643338:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551976448:0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.643348:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551976320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.643746:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789480097.643757:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551976832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.643809:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551976832:12345-0@lo:400:kworker.0 Request processed in 55us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.643815:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789480097.643840:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976192 00000100:00100000:2.0:1789480097.643845:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976192 00000100:00100000:2.0:1789480097.643876:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789480097.643884:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551976192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480097.643928:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551976192:12345-0@lo:400:kworker.0 Request processed in 45us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.643935:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789480097.645610:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551976832:0@lo:400:kworker.0 00000100:00100000:1.0:1789480097.645646:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551976192:0@lo:400:kworker.0 00010000:00010000:3.0:1789480097.889653:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480098.676206:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480098.676243:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480098.676266:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526825984 00000100:00100000:3.0:1789480098.676276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480098.676300:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526825984 00000100:00100000:1.0:1789480098.676368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:1.0:1789480098.676380:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526825984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480098.678074:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826240 00000100:00100000:0.0:1789480098.678084:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826240 00000100:00100000:0.0:1789480098.678150:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1789480098.678158:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526826240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480098.689369:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480098.689370:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526825984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 12985us (13166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480098.689388:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 305 00000100:00100000:1.0:1789480098.689467:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826496 00000100:00100000:1.0:1789480098.689476:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826496 00000100:00100000:1.0:1789480098.689524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826112 00000100:00100000:1.0:1789480098.689527:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826112 00000100:00100000:1.0:1789480098.689551:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1789480098.689560:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526826496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480098.689616:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526826496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 56us (13339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480098.689624:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:1.0:1789480098.689639:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:1.0:1789480098.689647:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:2348:x1876405526826112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480098.689763:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480098.689806:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826368 00000100:00100000:3.0:1789480098.689810:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826368 00000100:00100000:3.0:1789480098.689844:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1789480098.689851:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526826368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480098.689886:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526826368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480098.689893:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1789480098.693176:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+31:2348:x1876405526826112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3515us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480098.693192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00080000:1.0:1789480098.693239:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480098.693245:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480098.693248:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480098.699967:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+8:2348:x1876405526826240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21795us (23709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480098.699984:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00010000:00010000:0.0:1789480098.907670:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789480099.249777:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:0.0:1789480099.249792:0:5852:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d22925a99c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789480099.249797:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bab98240 00000020:00080000:0.0:1789480099.249800:0:5852:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d22bd692800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d22bab97000 00000001:00080000:0.0:1789480099.249824:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789480099.249857:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789480099.249895:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789480099.250074:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1789480099.268592:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1789480099.268616:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1789480099.268623:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1789480099.930521:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480100.187041:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480100.187075:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bafe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551976960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480100.187176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480100.187360:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551976960 00000100:00100000:1.0:1789480100.187371:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551976960 00000100:00100000:1.0:1789480100.187449:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789480100.187462:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551976960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480100.187510:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480100.187571:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551976960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480100.187578:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789480100.187601:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480100.187970:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bafe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551976960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480100.698835:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551977088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480100.698948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480100.703266:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977088 00000100:00100000:0.0:1789480100.703336:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977088 00000100:00100000:0.0:1789480100.703451:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789480100.703465:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551977088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480100.703520:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480100.703642:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551977088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480100.703649:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789480100.703833:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480100.703936:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789480100.703944:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bfd8c700, transno 4294967322 00000004:00080000:3.0:1789480100.703963:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bfd8d180, transno 4294967323 00000004:00080000:3.0:1789480100.703968:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789480100.704012:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551977088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480100.954954:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480101.270608:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480101.270814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826624 00000100:00100000:2.0:1789480101.270830:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826624 00000100:00100000:2.0:1789480101.270937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:2.0:1789480101.270952:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11276:x1876405526826624:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789480101.271147:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bafe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11276:x1876405526826624:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 198us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480101.271156:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00080000:1.0:1789480101.271723:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480101.275755:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480101.275922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526826880 00000100:00100000:3.0:1789480101.275935:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526826880 00000100:00100000:3.0:1789480101.276029:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1789480101.276051:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+18:11276:x1876405526826880:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480101.276547:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+19:11276:x1876405526826880:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 506us (804us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789480101.276555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:0.0:1789480101.978527:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480102.746531:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551977600:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480102.746694:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789480102.746701:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22a48dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551977216:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480102.746757:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551977728:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480102.746787:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977600 00000100:00100000:0.0:1789480102.746803:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977600 00000100:00100000:2.0:1789480102.746809:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551977472:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746848:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480102.746869:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789480102.746885:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789480102.746887:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551977344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480102.746896:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551977600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480102.746927:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551977856:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.746945:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480102.746959:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551977600:12345-0@lo:400:kworker.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.746968:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789480102.746971:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977728 00000100:00100000:2.0:1789480102.746974:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977728 00000100:00100000:0.0:1789480102.746984:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977856 00000100:00100000:0.0:1789480102.746986:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977856 00000100:00100000:2.0:1789480102.747004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977472 00000100:00100000:2.0:1789480102.747007:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977472 00000100:00100000:0.0:1789480102.747008:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789480102.747013:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551977856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789480102.747030:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551977728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480102.747047:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551977856:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.747053:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789480102.747072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977216 00000100:00100000:0.0:1789480102.747075:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977216 00000100:00100000:0.0:1789480102.747101:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789480102.747151:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405551977728:12345-0@lo:400:kworker.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480102.747167:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789480102.747178:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977344 00000100:00100000:2.0:1789480102.747181:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977344 00000100:00100000:2.0:1789480102.747202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789480102.747208:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551977472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747238:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551977472:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480102.747244:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789480102.747255:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789480102.747256:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551977216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747260:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551977344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747317:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551977344:12345-0@lo:400:kworker.0 Request processed in 56us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480102.747323:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789480102.747331:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e677fecc-98d9-457e-99be-c06439303d19+19:3298:x1876405551977216:12345-0@lo:400:kworker.0 Request processed in 77us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.747336:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:0.0:1789480102.747372:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480102.747378:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480102.747380:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480102.747416:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551977344:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747427:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551977856:0@lo:400:kworker.0 00000100:00100000:2.0:1789480102.747436:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551977472:0@lo:400:kworker.0 00000100:00100000:0.0:1789480102.747458:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22a48dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551977216:0@lo:400:kworker.0 00000100:00100000:0.0:1789480102.747468:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405551977728:0@lo:400:kworker.0 00000100:00100000:0.0:1789480102.747478:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551977600:0@lo:400:kworker.0 00010000:00010000:0.0:1789480103.005766:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480103.541949:0:12725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:48:22 (1789480102) 00000100:00100000:0.0:1789480103.806615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480103.806653:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480103.807314:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480103.807346:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480103.808033:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827136 00000100:00100000:2.0:1789480103.808047:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827136 00000100:00100000:2.0:1789480103.808137:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:2.0:1789480103.808150:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:2348:x1876405526827136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1789480103.808304:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:2348:x1876405526827136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 124us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480103.808313:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00080000:2.0:1789480103.808341:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480103.809964:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480103.810033:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827008 00000100:00100000:0.0:1789480103.810043:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827008 00000100:00100000:0.0:1789480103.810096:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:0.0:1789480103.810117:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526827008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480103.810194:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526827008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 90us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480103.810202:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 307 00000100:00100000:0.0:1789480103.810641:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827520 00000100:00100000:0.0:1789480103.810648:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827520 00000100:00100000:0.0:1789480103.810715:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:0.0:1789480103.810893:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526827520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480103.810943:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2348:x1876405526827520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 221us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480103.810951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00080000:0.0:1789480103.815030:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480103.816484:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827392 00000100:00100000:1.0:1789480103.816503:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827392 00000100:00100000:1.0:1789480103.816591:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827264 00000100:00100000:1.0:1789480103.816595:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827264 00000100:00100000:1.0:1789480103.816630:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1789480103.816643:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526827392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480103.816860:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1789480103.816872:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526827264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480103.816961:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2348:x1876405526827264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 92us (9614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480103.816982:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00080000:0.0:1789480103.817011:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480103.817016:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480103.817126:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2348:x1876405526827392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 486us (10471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480103.817134:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00010000:00010000:1.0:1789480104.028571:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789480104.326160:0:5852:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1789480104.326195:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789480104.326260:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789480104.326272:0:5863:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789480105.050424:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480105.306575:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480105.306607:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551977984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480105.306814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480105.306977:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551977984 00000100:00100000:0.0:1789480105.306988:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551977984 00000100:00100000:0.0:1789480105.307070:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789480105.307081:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551977984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480105.307130:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480105.307190:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551977984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480105.307198:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789480105.307608:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480105.307672:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551977984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480105.827081:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551978112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480105.827295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480105.827409:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978112 00000100:00100000:2.0:1789480105.827419:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978112 00000100:00100000:2.0:1789480105.827493:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789480105.827504:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551978112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480105.827555:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480105.829383:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551978112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1866us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480105.829403:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789480105.829450:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480105.829576:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551978112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789480106.074761:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480106.396448:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480106.396561:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827648 00000100:00100000:2.0:1789480106.396574:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827648 00000100:00100000:2.0:1789480106.396728:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:2.0:1789480106.396743:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:12288:x1876405526827648:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:2.0:1789480106.396901:0:8260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480106.396932:0:8260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3536 expref: -99 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480106.397094:0:8260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480106.397112:0:8260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480106.397127:0:8260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789480106.397135:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789480106.397196:0:8260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480106.397555:0:8260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480106.404123:0:8260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480106.404196:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22baffe400/0xbb972366037fe444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3536 expref: 7 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480106.404252:0:8260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3536 expref: 6 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480106.404263:0:8260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:0.0:1789480106.404267:0:8260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480106.404272:0:8260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff600, rc 0) 00000100:00100000:0.0:1789480106.404418:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:12288:x1876405526827648:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 7677us (7987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480106.404464:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000040:00080000:0.0:1789480106.458966:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480106.459122:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480106.460919:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789480106.460942:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789480107.103905:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480107.867128:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551978496:0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.867237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480107.867347:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789480107.867355:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551978368:0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.867380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480107.867398:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551978880:0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.867454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480107.867498:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978496 00000100:00100000:1.0:1789480107.867507:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978496 00000100:00100000:1.0:1789480107.867569:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978368 00000100:00100000:1.0:1789480107.867572:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978368 00000100:00100000:1.0:1789480107.867691:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789480107.867705:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551978496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.867932:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551978496:12345-0@lo:400:kworker.0 Request processed in 230us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.867949:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789480107.867971:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789480107.867978:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551978368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.868011:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551978368:12345-0@lo:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.868018:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1789480107.868036:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480107.868076:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551978368:0@lo:400:kworker.0 00000100:00100000:1.0:1789480107.868089:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551978496:0@lo:400:kworker.0 00000100:00100000:0.0:1789480107.868437:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978880 00000100:00100000:0.0:1789480107.868444:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978880 00000100:00100000:0.0:1789480107.868492:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789480107.868501:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551978880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480107.868548:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551978880:12345-0@lo:400:kworker.0 Request processed in 49us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480107.868554:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789480107.868621:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22c1e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551978880:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.868799:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551978240:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.868850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480107.868887:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551978752:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.868912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480107.868935:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480107.868942:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551978624:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.868966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480107.868996:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978240 00000100:00100000:2.0:1789480107.869001:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978240 00000100:00100000:2.0:1789480107.869032:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789480107.869039:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551978240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.869077:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551978240:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480107.869083:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789480107.869114:0:8279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978624 00000100:00100000:2.0:1789480107.869118:0:8279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978624 00000100:00100000:2.0:1789480107.869142:0:8279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789480107.869149:0:8279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551978624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.869195:0:8279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551978624:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480107.869201:0:8279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789480107.869238:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551978624:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.869246:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551978240:0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.869308:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551978752 00000100:00100000:2.0:1789480107.869313:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551978752 00000100:00100000:2.0:1789480107.869344:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789480107.869350:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551978752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480107.869385:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551978752:12345-0@lo:400:kworker.0 Request processed in 35us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480107.869391:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789480107.869412:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551978752:0@lo:400:kworker.0 00000100:00080000:1.0:1789480107.869711:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480107.869716:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480107.869719:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789480108.125272:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480108.686216:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480108.686504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526827904 00000100:00100000:0.0:1789480108.686519:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526827904 00000100:00100000:0.0:1789480108.686684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1789480108.686698:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+18:12289:x1876405526827904:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789480108.687645:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:12289:x1876405526827904:12345-192.168.204.54@tcp:35:umount.0 Request processed in 847us (1341us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789480108.687660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1789480108.690904:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00080000:1.0:1789480108.691276:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480108.691417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526828160 00000100:00100000:0.0:1789480108.691431:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526828160 00000100:00100000:0.0:1789480108.691518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1789480108.691531:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+19:12289:x1876405526828160:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:0.0:1789480108.692193:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+20:12289:x1876405526828160:12345-192.168.204.54@tcp:35:umount.0 Request processed in 662us (1300us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789480108.692203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1789480108.698785:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480108.698956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526828416 00000100:00100000:3.0:1789480108.698971:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526828416 00000100:00100000:3.0:1789480108.699033:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1789480108.699044:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2286ead850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+20:12289:x1876405526828416:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:3.0:1789480108.699423:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2286ead850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+21:12289:x1876405526828416:12345-192.168.204.54@tcp:35:umount.0 Request processed in 370us (650us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789480108.699432:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1789480108.703914:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480108.704383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526828672 00000100:00100000:3.0:1789480108.704399:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526828672 00000100:00100000:3.0:1789480108.705251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1789480108.705271:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+21:12289:x1876405526828672:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:3.0:1789480108.705819:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f712dbb2-3172-402a-b822-94513dd5b6e3+22:12289:x1876405526828672:12345-192.168.204.54@tcp:35:umount.0 Request processed in 554us (1925us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789480108.705829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1789480108.711046:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480108.711449:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480108.711489:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480108.714705:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526828928 00000100:00100000:0.0:1789480108.714748:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526828928 00000100:00100000:0.0:1789480108.714852:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526829184 00000100:00100000:0.0:1789480108.714857:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526829184 00000100:00100000:0.0:1789480108.714881:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526829056 00000100:00100000:0.0:1789480108.714884:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526829056 00000100:00100000:0.0:1789480108.714907:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789480108.714919:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+15:2348:x1876405526828928:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480108.714944:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480108.714971:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4c00/0xbb972366037fd499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30c8 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480108.714996:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480108.715078:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+14:2348:x1876405526828928:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 161us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480108.715087:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789480108.715112:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789480108.715120:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+13:2348:x1876405526829184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480108.715129:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480108.715139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2600/0xbb972366037fd6e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3193 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480108.715171:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480108.715261:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:2348:x1876405526829184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 142us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480108.715321:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789480108.715381:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480108.715389:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:2348:x1876405526829056:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480108.715398:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480108.715407:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d3000/0xbb972366037fd437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3090 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480108.715420:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480108.716040:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2348:x1876405526829056:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 646us (4544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480108.716050:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480108.716955:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480108.719400:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526828800 00000100:00100000:3.0:1789480108.719422:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526828800 00000100:00100000:3.0:1789480108.719899:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1789480108.719928:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+5:2344:x1876405526828800:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:3.0:1789480108.719970:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd7a9 00000100:00080000:3.0:1789480108.719982:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d2288f51000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480108.720047:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1789480108.720626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789480108.720691:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480108.722692:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+2:2344:x1876405526828800:12345-192.168.204.54@tcp:9:umount.0 Request processed in 2751us (5728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480108.722709:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1789480108.732353:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480108.733267:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526829568 00000100:00100000:1.0:1789480108.733321:0:12025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526829568 00000100:00100000:1.0:1789480108.733417:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1789480108.733430:0:12025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2344:x1876405526829568:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:1.0:1789480108.733598:0:12025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fda0a 00000020:00010000:1.0:1789480108.733608:0:12025:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2291255800: total 0 00000100:00080000:1.0:1789480108.733614:0:12025:0:(import.c:65:import_set_state_nolock()) ffff8d22babd9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480108.733667:0:12025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:3.0:1789480108.734092:0:5817:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2291255800: total 0 00010000:00010000:3.0:1789480108.734167:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2291255800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789480108.734338:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008acc0e5/0xbb972366037fddad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3368 expref: 6 pid: 8279 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.734384:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d82a0324/0xbb972366037fe43d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f352f expref: 5 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.734399:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2291255800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789480108.734413:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480108.734415:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480108.734417:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480108.734539:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480108.736007:0:12025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f712dbb2-3172-402a-b822-94513dd5b6e3+2:2344:x1876405526829568:12345-192.168.204.54@tcp:9:umount.0 Request processed in 2562us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480108.736029:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:2.0:1789480108.757965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480108.760694:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526830592 00000100:00100000:1.0:1789480108.760765:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526830592 00000100:00100000:1.0:1789480108.760889:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:1.0:1789480108.760906:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+22:2344:x1876405526830592:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1789480108.761018:0:5830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd445 00000020:00010000:1.0:1789480108.761059:0:5830:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d22babdf800: total 0 00000100:00080000:1.0:1789480108.761070:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8d21854fe800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480108.761120:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1789480108.761427:0:11176:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d22babdf800: total 0 00010000:00010000:3.0:1789480108.761535:0:11176:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d22babdf800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789480108.761586:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d228804db00) 00010000:00010000:3.0:1789480108.761591:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480108.761601:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffe00/0xbb972366037fd70f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a1 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761633:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480108.761647:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480108.761652:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4e00/0xbb972366037fdd98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3361 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761669:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:3.0:1789480108.761672:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480108.761675:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4a00/0xbb972366037fde01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f337d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761686:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480108.761688:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480108.761691:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4200/0xbb972366037fda6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f328f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761703:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480108.761705:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480108.761708:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fdc8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f331b expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761720:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480108.761722:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480108.761725:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ca00/0xbb972366037fe3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f351a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761737:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d22b7076800) 00010000:00010000:3.0:1789480108.761740:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480108.761743:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5200/0xbb972366037fd77f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31bd expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761780:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480108.761782:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480108.761786:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037fe428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3528 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761812:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2290ce3200) 00010000:00010000:3.0:1789480108.761815:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480108.761818:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7000/0xbb972366037fd72b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f31a8 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761833:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480108.761836:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480108.761840:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafffa00/0xbb972366037fe0fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3456 expref: 12 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761850:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2290ce3800) 00010000:00010000:3.0:1789480108.761853:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480108.761855:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe31e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f34e2 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761869:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480108.761871:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480108.761875:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147000/0xbb972366037fde1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3384 expref: 10 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761889:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2290ce3000) 00010000:00010000:3.0:1789480108.761891:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480108.761901:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22c2147600/0xbb972366037fdd6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3353 expref: 9 pid: 11710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480108.761916:0:11176:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d22babdf800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789480108.761929:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480108.761931:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480108.761933:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480108.763707:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f712dbb2-3172-402a-b822-94513dd5b6e3+7:2344:x1876405526830592:12345-192.168.204.54@tcp:39:umount.0 Request processed in 2789us (7962us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789480108.763726:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:3.0:1789480108.913083:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480108.913254:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526830720 00000100:00100000:0.0:1789480108.913268:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526830720 00000100:00100000:0.0:1789480108.913457:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:0.0:1789480108.913471:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2348:x1876405526830720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480108.913588:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2348:x1876405526830720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 120us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480108.913597:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00080000:1.0:1789480108.916060:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480109.146600:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789480109.464372:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:2.0:1789480109.464406:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000001:00080000:2.0:1789480109.464412:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789480109.464434:0:5852:0:(genops.c:885:class_export_put()) final put ffff8d22babdf800/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:1.0:1789480109.466008:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22babdf800/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-MDT0000 00000020:00000080:1.0:1789480109.466126:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d21854fe800 for lustre-MDT0000 00000001:00100000:3.0:1789480109.483147:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:3.0:1789480109.483160:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d2291255800/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:2.0:1789480109.483215:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2291255800/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-OST0000 00000020:00000080:2.0:1789480109.483316:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22babd9800 for lustre-OST0000 00000001:00100000:2.0:1789480109.971317:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:2.0:1789480109.971331:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d22a4b4f800/f712dbb2-3172-402a-b822-94513dd5b6e3 00000020:00000080:0.0:1789480109.971458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4b4f800/f712dbb2-3172-402a-b822-94513dd5b6e3 for lustre-OST0001 00000020:00000080:0.0:1789480109.971538:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2288f51000 for lustre-OST0001 00010000:00010000:3.0:1789480110.171988:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480110.426673:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480110.426737:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551979008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480110.426830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480110.427052:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979008 00000100:00100000:3.0:1789480110.427062:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979008 00000100:00100000:3.0:1789480110.427153:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789480110.427166:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551979008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480110.427226:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480110.427307:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551979008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480110.427315:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789480110.427378:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480110.427580:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551979008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480110.437404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480110.437465:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480110.437510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480110.437611:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526830848 00000100:00100000:2.0:1789480110.437625:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526830848 00000100:00100000:2.0:1789480110.437718:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526831104 00000100:00100000:2.0:1789480110.437722:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526831104 00000100:00100000:2.0:1789480110.437748:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526830976 00000100:00100000:2.0:1789480110.437752:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526830976 00000100:00100000:2.0:1789480110.437772:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480110.437784:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+12:2346:x1876405526830848:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480110.437804:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480110.437829:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22baffe200/0xbb972366037fd517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30dd expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.437852:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480110.437924:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+11:2346:x1876405526830848:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 142us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.437931:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480110.437953:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789480110.437959:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+10:2346:x1876405526831104:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480110.437967:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480110.437977:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d2a00/0xbb972366037fd6b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f318c expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.437986:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480110.438005:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a485d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+9:2346:x1876405526831104:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 47us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.438029:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789480110.438042:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789480110.438048:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+8:2346:x1876405526830976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480110.438056:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480110.438065:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030c00/0xbb972366037fd51e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3107 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.438075:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480110.438094:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0d717579-5363-42c9-a5a4-3c4ed264ebef+7:2346:x1876405526830976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.438100:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480110.456544:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480110.457275:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526831360 00000100:00100000:2.0:1789480110.457324:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526831360 00000100:00100000:2.0:1789480110.457434:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:2.0:1789480110.457447:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b6ec658-f7f1-408f-9531-0dbaf67922ea+6:2344:x1876405526831360:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:2.0:1789480110.457506:0:11710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd52c 00000020:00010000:2.0:1789480110.457517:0:11710:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d229c50b000: total 0 00000100:00080000:2.0:1789480110.457525:0:11710:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789480110.457565:0:11710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789480110.458141:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b6ec658-f7f1-408f-9531-0dbaf67922ea+5:2344:x1876405526831360:12345-192.168.204.54@tcp:39:umount.0 Request processed in 693us (1608us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789480110.458151:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000020:00010000:0.0:1789480110.458427:0:11176:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d229c50b000: total 0 00010000:00010000:0.0:1789480110.458433:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480110.458486:0:11176:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d229c50b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789480110.458551:0:11176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22b7076d00) 00010000:00010000:0.0:1789480110.458555:0:11176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480110.458566:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bafff600/0xbb972366037fe44b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3536 expref: 4 pid: 8260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480110.458596:0:11176:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d229c50b000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789480110.458606:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480110.458608:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480110.458610:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480110.459141:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480110.490132:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480110.490339:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526831616 00000100:00100000:0.0:1789480110.490352:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526831616 00000100:00100000:0.0:1789480110.490425:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 309 00000100:00100000:0.0:1789480110.490439:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+7:2344:x1876405526831616:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:0.0:1789480110.490513:0:5824:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd422 00000020:00010000:0.0:1789480110.490523:0:5824:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d21854fa000: total 0 00000100:00080000:0.0:1789480110.490530:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8d21854f8800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789480110.490632:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a443a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d717579-5363-42c9-a5a4-3c4ed264ebef+3:2344:x1876405526831616:12345-192.168.204.54@tcp:251:umount.0 Request processed in 196us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480110.490642:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 309 00000020:00010000:1.0:1789480110.490862:0:5818:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d21854fa000: total 0 00010000:00010000:1.0:1789480110.490917:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d21854fa000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789480110.490967:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2146000/0xbb972366037fd4bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f30cf expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480110.490989:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d21854fa000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789480110.490999:0:5818:0:(genops.c:885:class_export_put()) final put ffff8d21854fa000/0d717579-5363-42c9-a5a4-3c4ed264ebef 00010000:00010000:1.0:1789480110.491015:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480110.491017:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480110.491018:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789480110.491028:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d21854fa000/0d717579-5363-42c9-a5a4-3c4ed264ebef for MGS 00000020:00000080:1.0:1789480110.491067:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d21854f8800 for MGS 00000100:00100000:1.0:1789480110.938602:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480110.938633:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551979136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480110.938745:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480110.939270:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979136 00000100:00100000:2.0:1789480110.939315:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979136 00000100:00100000:2.0:1789480110.939450:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789480110.939468:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551979136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480110.939514:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480110.939574:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551979136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.939594:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789480110.941596:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480110.941682:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551979136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480111.197231:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480112.218446:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789480112.485023:0:12926:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789480112.499242:0:12926:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789480112.499842:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.499863:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.499872:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.499903:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.499987:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480112.499995:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789480112.500037:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480112.500044:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789480112.500051:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789480112.500099:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d22ba118000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789480112.500811:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551979264:0@lo:39:umount.0 00000100:00100000:3.0:1789480112.500909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480112.502548:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979264 00000100:00100000:0.0:1789480112.502565:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979264 00000100:00100000:0.0:1789480112.502650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789480112.502677:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876405551979264:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789480112.502720:0:5831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd231 00000100:00080000:0.0:1789480112.502732:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8d22b9aa3800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789480112.504518:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480112.504536:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.504552:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480112.504557:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.504569:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480112.504577:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480112.504582:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480112.504585:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789480112.504588:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789480112.504656:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.506582:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480112.506640:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.506651:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bafff200/0xbb972366037fd4ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480112.507488:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551979392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480112.507582:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480112.507609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.507614:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.507619:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480112.508245:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979392 00000100:00100000:2.0:1789480112.508258:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979392 00000100:00100000:2.0:1789480112.508482:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789480112.508498:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+19:3299:x1876405551979392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480112.508508:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.508521:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480112.508547:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2146e00/0xbb972366037fd4b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd4ae expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.508566:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480112.508654:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+18:3299:x1876405551979392:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.508882:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551979392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480112.509114:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1876405551979264:12345-0@lo:39:umount.0 Request processed in 6452us (8202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480112.509124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1789480112.509140:0:5831:0:(genops.c:885:class_export_put()) final put ffff8d22b9aa4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789480112.509267:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22ba118000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789480112.509314:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551979264:0@lo:39:umount.0 00000020:00000080:1.0:1789480112.509350:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22b9aa4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1789480112.509386:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480112.509394:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789480112.509402:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480112.509416:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22b9aa3800 for lustre-MDT0000 00010000:00010000:0.0:1789480112.516539:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516559:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516743:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516753:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480112.516836:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789480112.516846:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480112.516856:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516866:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516872:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.516879:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.519808:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480112.519825:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.519839:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480112.519843:0:11176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.519855:0:11176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480112.519863:0:11176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480112.519870:0:11176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789480112.519874:0:11176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789480112.519924:0:11176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.519931:0:11176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480112.519981:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.519989:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22c2147200/0xbb972366037fd4c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.520010:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480112.520015:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.520021:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480112.520044:0:11176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.520051:0:11176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480112.520093:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480112.520119:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551979520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480112.520194:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480112.520256:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979520 00000100:00100000:1.0:1789480112.520264:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979520 00000100:00100000:1.0:1789480112.520347:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480112.520360:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+18:3301:x1876405551979520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480112.520373:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480112.520390:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280031a00/0xbb972366037fd4ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd4c3 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480112.520405:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480112.520447:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e677fecc-98d9-457e-99be-c06439303d19+17:3301:x1876405551979520:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.520455:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480112.520528:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551979520:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789480112.520864:0:11176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480112.520871:0:11176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789480112.520874:0:11176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789480112.520894:0:11176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.520901:0:11176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480112.520931:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.520942:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480112.520944:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480112.520947:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480112.520965:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551979648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480112.521038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480112.521694:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979648 00000100:00100000:3.0:1789480112.521704:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979648 00000100:00100000:3.0:1789480112.521755:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789480112.521763:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a49ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+17:3301:x1876405551979648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480112.521775:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480112.521789:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2146400/0xbb972366037fd3e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd3dc expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.521807:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480112.521875:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a49ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e677fecc-98d9-457e-99be-c06439303d19+16:3301:x1876405551979648:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480112.521893:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789480112.522017:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789480112.522025:0:12926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280030200/0xbb972366037fd3dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd3e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480112.522041:0:12926:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789480112.522052:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522154:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522170:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522178:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522201:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480112.522208:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522216:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522223:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522229:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480112.522238:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789480112.522240:0:12926:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789480112.522243:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789480112.522277:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:0.0:1789480112.522305:0:12926:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1789480112.522309:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1789480112.522311:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789480112.522322:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1789480112.522332:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7c00 already unused, calling callback (ffffffffc1af9c20) 00000020:00000080:0.0:1789480112.522334:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 10000000:00010000:2.0:1789480112.522342:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480112.522347:0:12926:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2186b3f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480112.522372:0:12926:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d22bfd4c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480112.522412:0:12926:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d229c50b000 4b6ec658-f7f1-408f-9531-0dbaf67922ea 192.168.204.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789480112.522419:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480112.522420:0:12926:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d229c7db380) has exports, disconnecting them 00000020:00080000:0.0:1789480112.522431:0:12926:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2186b3f800), last request at 1789480107 10000000:00010000:2.0:1789480112.522442:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789480112.522445:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd3a4 10000000:01000000:2.0:1789480112.522457:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789480112.522461:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789480112.522464:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1789480112.522470:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d2186b39800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789480112.522510:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.522519:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789480112.522521:0:12926:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2186b3f800): rc 0 00000020:00000080:0.0:1789480112.522525:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d2186b3f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789480112.522537:0:12926:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d22bfd4c800), last request at 1789480107 00000020:00000080:0.0:1789480112.522540:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd2d9 00000100:00080000:0.0:1789480112.522547:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d22bfd48000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789480112.522554:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480112.522556:0:12926:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22bfd4c800): rc 0 00000020:00000080:0.0:1789480112.522565:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bfd4c800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1789480112.522576:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7c00/0xbb972366037fd6d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6de expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1789480112.522581:0:12926:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa28701c73ae0 00010000:00010000:2.0:1789480112.522593:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480112.522599:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.522606:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22b7138c00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480112.522609:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480112.522615:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:2.0:1789480112.522617:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480112.522621:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789480112.522641:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:00010000:2.0:1789480112.522643:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480112.522650:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480112.522653:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789480112.522656:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789480112.522692:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.522698:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480112.522709:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480112.522713:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:2.0:1789480112.522717:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22b7138c00/0xbb972366037fd190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480112.522738:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d22925b4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789480112.522741:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.522744:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.522749:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480112.522757:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789480112.522762:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789480112.522772:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480112.522784:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551979776:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789480112.522831:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789480112.522844:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d2283eae000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789480112.522856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789480112.522900:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d229c7db380) has no exports 00000100:00100000:2.0:1789480112.522934:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480112.522942:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551979904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480112.522967:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480112.523128:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979776 00000100:00100000:2.0:1789480112.523136:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979776 00000100:00100000:2.0:1789480112.523193:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551979904 00000100:00100000:2.0:1789480112.523198:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551979904 00000100:00100000:2.0:1789480112.523233:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789480112.523251:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+17:3298:x1876405551979776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480112.523269:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480112.523312:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4000/0xbb972366037fd6de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd6d7 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.523328:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.523331:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480112.523338:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480112.523384:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+16:3298:x1876405551979776:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480112.523392:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789480112.523413:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480112.523419:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+15:3298:x1876405551979904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480112.523427:0:8453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480112.523436:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22813d3800/0xbb972366037fd197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd190 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.523449:0:8453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480112.523469:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e677fecc-98d9-457e-99be-c06439303d19+14:3298:x1876405551979904:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480112.523474:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480112.523515:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551979904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480112.523523:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551979776:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789480112.523684:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480112.523741:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bfd4c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480112.523778:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2186b39800 for lustre-MDT0000 00000020:00000080:1.0:1789480112.523784:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22bfd48000 for lustre-MDT0000 00000100:00100000:1.0:1789480112.524235:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e677fecc-98d9-457e-99be-c06439303d19:3301:1876405551979648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480112.524267:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551980032:0@lo:9:umount.0 00000100:00100000:1.0:1789480112.524346:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480112.524382:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551980160:0@lo:9:umount.0 00000100:00100000:1.0:1789480112.524405:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480112.524445:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980032 00000100:00100000:1.0:1789480112.524452:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980032 00000100:00100000:1.0:1789480112.524499:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980160 00000100:00100000:1.0:1789480112.524502:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980160 00000100:00100000:1.0:1789480112.524529:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789480112.524539:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1876405551980032:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789480112.524566:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd326 00000100:00080000:1.0:1789480112.524574:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2185564800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480112.524611:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789480112.524957:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1876405551980032:12345-0@lo:9:umount.0 Request processed in 418us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.524966:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789480112.524983:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789480112.524991:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1876405551980160:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789480112.525004:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd41b 00000100:00080000:1.0:1789480112.525010:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2283ea8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480112.525032:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789480112.525244:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1876405551980160:12345-0@lo:9:umount.0 Request processed in 252us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.525251:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789480112.525305:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480112.525309:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480112.525323:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480112.525328:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480112.525349:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22925b4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480112.525364:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789480112.525366:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480112.525370:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551980032:0@lo:9:umount.0 00000100:00080000:1.0:1789480112.525382:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2283eae000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480112.525389:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789480112.525391:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480112.525393:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551980160:0@lo:9:umount.0 00000020:00080000:2.0:1789480112.551612:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d229c7db380) has no exports 00000020:00000080:2.0:1789480112.657002:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1eb 00000020:00000080:2.0:1789480112.657031:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3bf800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789480112.657067:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789480112.657534:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480112.657551:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789480112.657557:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d22bd6b3380) has no exports 00000020:00000080:1.0:1789480112.657661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3bf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789480112.658169:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1e4 00000020:00000080:3.0:1789480112.658181:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bd6bc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480112.661561:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bd6bc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789480112.662210:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480112.662225:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789480112.662231:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22c1e2b000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789480112.662234:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22c1e2b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789480112.662248:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1789480112.986725:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551980416:0@lo:400:kworker.0 00000100:00100000:3.0:1789480112.986805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480112.986895:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480112.986902:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551980288:0@lo:400:kworker.0 00000100:00100000:3.0:1789480112.986923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480112.987033:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980416 00000100:00100000:1.0:1789480112.987041:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980416 00000100:00100000:1.0:1789480112.987092:0:11710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980288 00000100:00100000:1.0:1789480112.987095:0:11710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980288 00000100:00100000:1.0:1789480112.987116:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789480112.987124:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1876405551980416:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789480112.987132:0:11710:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789480112.987194:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1876405551980416:12345-0@lo:400:kworker.0 Request processed in 70us (389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480112.987202:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789480112.987221:0:11710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789480112.987225:0:11710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1876405551980288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789480112.987229:0:11710:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789480112.987262:0:11710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1876405551980288:12345-0@lo:400:kworker.0 Request processed in 24us (326us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480112.987303:0:11710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1789480112.987313:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480112.987318:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789480112.987322:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480113.015221:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480113.015235:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 175 00000100:00080000:0.0:1789480113.015253:0:3301:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2185560000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480113.015372:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187731f80 x1876405551980544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480113.015403:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551980288:0@lo:400:kworker.0 00000100:00080000:0.0:1789480113.015434:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480113.015439:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789480113.015444:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480113.015447:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480113.015453:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1789480113.015459:0:3301:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d229c50f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480113.015473:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551980544:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789480113.015479:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187731880 x1876405551980672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480113.015497:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551980416:0@lo:400:kworker.0 00000100:00100000:1.0:1789480113.015585:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480113.015677:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551980672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789480113.015703:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480113.015767:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980544 00000100:00100000:1.0:1789480113.015776:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980544 00000100:00100000:1.0:1789480113.015815:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551980672 00000100:00100000:1.0:1789480113.015817:0:8260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551980672 00000100:00100000:1.0:1789480113.015837:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789480113.015845:0:8260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3297:x1876405551980544:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789480113.015867:0:8260:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789480113.017197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789480113.017207:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405551980672:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789480113.017247:0:5832:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789480113.017380:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405551980672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 172us (1675us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480113.017389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789480113.017465:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480113.017472:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480113.017478:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551980672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789480113.035954:0:8260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3297:x1876405551980544:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 20099us (20362us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789480113.035970:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789480113.036417:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480113.036432:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480113.036439:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551980544:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789480113.245390:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480114.267791:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789480114.582331:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000001:00080000:0.0:1789480114.582350:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789480114.582356:0:5852:0:(genops.c:885:class_export_put()) final put ffff8d229c50b000/4b6ec658-f7f1-408f-9531-0dbaf67922ea 00000020:00000080:0.0:1789480114.582381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50b000/4b6ec658-f7f1-408f-9531-0dbaf67922ea for lustre-MDT0000 00000020:00000080:0.0:1789480114.582439:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d229c50f800 for lustre-MDT0000 00000001:00100000:3.0:1789480114.638190:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789480114.638197:0:6710:0:(genops.c:885:class_export_put()) final put ffff8d2185565000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480114.638359:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2185565000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789480114.638596:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2185564800 for lustre-OST0000 00000020:01000000:3.0:1789480114.715258:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2185d840c0 - data ffff8d22bfe08438/ffff8d2185215800 00000020:01000000:3.0:1789480114.715770:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22ae8a09c0 - data ffff8d229df70870/ffff8d229c540000 00000001:00000004:3.0:1789480114.725387:0:12926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789480114.837522:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789480114.837532:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789480114.837656:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480114.837659:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789480114.839097:0:6805:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789480114.839114:0:6805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789480114.839126:0:6805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789480114.840770:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789480114.840778:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789480114.840836:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789480114.840839:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789480114.841910:0:8094:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789480114.841917:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789480114.841927:0:8094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789480114.940986:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1b3 00000020:00000080:1.0:1789480114.941001:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789480114.941725:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789480114.942868:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1c8 00000020:00000080:1.0:1789480114.942879:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789480114.942939:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789480114.942946:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.942955:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480114.942960:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d229c7d99c0) has no exports 00000004:01000000:1.0:1789480114.943144:0:12926:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789480114.943153:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd406 00000020:00000080:1.0:1789480114.943169:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d2283eac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480114.943674:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789480114.943806:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789480114.943812:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.943820:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480114.943823:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d22b99c4d40) has no exports 00000020:00000080:1.0:1789480114.943830:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd3ff 00000020:00000080:1.0:1789480114.943836:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d2283eaf800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789480114.944212:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789480114.944218:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789480114.944221:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789480114.944227:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480114.944230:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480114.944263:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.944270:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480114.944276:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd31f 00000020:00000080:1.0:1789480114.944301:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22c1e29000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789480114.944306:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789480114.944310:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.944314:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480114.944317:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d22bd6b0000) has no exports 00000020:00000080:1.0:1789480114.944321:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd318 00000020:00000080:1.0:1789480114.944324:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22925b0000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789480114.944678:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789480114.944681:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789480114.944684:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789480114.944688:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480114.944689:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480114.944714:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.944720:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480114.944744:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.944747:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480114.944749:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d229c443000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480114.944761:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c443000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789480114.944767:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480114.944929:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1cf 00000020:00000080:1.0:1789480114.944934:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e4800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789480114.944938:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789480114.944941:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.944945:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480114.944948:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d229c7d8000) has no exports 00000020:00000080:1.0:1789480114.944969:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.944972:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789480114.944975:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd1d6 00000020:00000080:1.0:1789480114.944979:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e5000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789480114.944986:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22aea50800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789480114.944989:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22aea50800 3 00000020:01000004:1.0:1789480114.944992:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d22aea50800 from lustre-MDT0000 00000020:00000080:1.0:1789480114.945010:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.945013:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789480114.945016:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e7800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789480114.945018:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789480114.945024:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789480114.945063:0:12926:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789480114.945067:0:12926:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789480114.945070:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789480114.945073:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.945075:0:12926:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789480114.945082:0:12926:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d22876cb800 e677fecc-98d9-457e-99be-c06439303d19 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789480114.945088:0:12926:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d229c7219c0) has exports, disconnecting them 00000020:00080000:1.0:1789480114.945092:0:12926:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d22876cb800), last request at 1789479862 00000020:00000080:1.0:1789480114.945107:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd174 00000020:00010000:1.0:1789480114.945112:0:12926:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d22876cb800: total 6 00000100:00080000:1.0:1789480114.945116:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8d22876c8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789480114.945137:0:12926:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22876cb800): rc 0 00000020:00080000:1.0:1789480114.945147:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d229c7219c0) has no exports 00000020:00010000:1.0:1789480114.945166:0:5817:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d22876cb800: total 6 00010000:00010000:1.0:1789480114.945186:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d22876cb800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789480114.945214:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5000/0xbb972366037fd6c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd6bb expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945232:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280030000/0xbb972366037fd492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd48b expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945243:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5800/0xbb972366037fd6d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd6c9 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945257:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2280031400/0xbb972366037fd484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd47d expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945270:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22b7138800/0xbb972366037fd28c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd285 expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945307:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2147a00/0xbb972366037fd4a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd4a0 expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945318:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fd476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd46f expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945327:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22c2146c00/0xbb972366037fd4d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb972366037fd4d1 expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.945338:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d22876cb800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789480114.945349:0:5817:0:(genops.c:885:class_export_put()) final put ffff8d22876cb800/e677fecc-98d9-457e-99be-c06439303d19 00010000:00010000:1.0:1789480114.945356:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480114.945357:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480114.945365:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480114.945467:0:5823:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d22a4be2e00:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1789480114.945557:0:5824:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d22aeb70e00:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1789480114.945600:0:5825:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d22aeb71e00:5825] 2 exiting: rc = 0 00000100:00100000:1.0:1789480114.945651:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945659:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945666:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945672:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945678:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945684:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945691:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945697:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945704:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945710:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945716:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945721:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945727:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945732:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945737:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945742:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945748:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945753:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945759:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945764:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945770:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945775:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945780:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945786:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945792:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945799:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945805:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945810:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945816:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945822:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945836:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945841:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945846:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945851:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945856:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945861:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945866:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945872:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945877:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945882:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945888:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945894:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945899:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945905:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945910:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945916:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945921:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945926:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945932:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945937:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945943:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945948:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945953:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945959:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945964:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945970:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945976:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945983:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945989:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.945995:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.946001:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.946006:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.946013:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480114.946019:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789480114.946436:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789480114.946445:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1789480114.950510:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283eac800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789480114.950528:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283eaf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480114.950536:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2283eae000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789480114.950548:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d22bb594800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480114.950551:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb594800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789480114.950556:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480114.950648:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22c1e29000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789480114.950657:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22925b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480114.950662:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22925b4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789480114.950667:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d22925b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480114.950669:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22925b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789480114.950672:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480114.950762:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789480114.950767:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d22bb3e1000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789480114.950769:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789480114.950772:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789480114.950968:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bb3e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480114.950973:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22876cb800/e677fecc-98d9-457e-99be-c06439303d19 for MGS 00000020:00000080:0.0:1789480114.951023:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22876c8800 for MGS 00000020:01000000:2.0:1789480114.952307:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2185d84f00 - data ffff8d22bfe08870/ffff8d2185216400 00000020:01000000:2.0:1789480114.952421:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d22924e3c00 - data ffff8d22a07ff510/ffff8d22a4486000 00000020:00000080:2.0:1789480114.952894:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd158 00000020:00000080:2.0:1789480114.952902:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22a0284800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789480114.952926:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22aea50800 from MGS, refs=2 00000020:01000004:2.0:1789480114.952930:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22aea50800 2 00000020:01000004:2.0:1789480114.952933:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d22aea50800 from MGS 00000020:00000080:2.0:1789480114.952952:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480114.952958:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789480114.952961:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22a0286800/MGS 00000020:00000080:2.0:1789480114.952973:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0286800/MGS for MGS 00000020:01000000:2.0:1789480114.952982:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789480114.953043:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789480114.953047:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480114.953052:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789480114.953059:0:12926:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d22ba11f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789480114.953065:0:12926:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8d22b99c19c0) has exports, disconnecting them 00000020:00080000:2.0:1789480114.953069:0:12926:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d22ba11f800), last request at 1789479863 00000020:00000080:2.0:1789480114.953073:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd223 00000020:00080000:2.0:1789480114.953082:0:12926:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22ba11f800): rc 0 00000020:00000080:2.0:1789480114.953086:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22ba11f800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789480114.955495:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789480114.955505:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480114.955510:0:12926:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789480114.955518:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480114.955710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0284800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789480114.955721:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22ba11f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789480114.955728:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22ba118000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789480114.957428:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480114.957442:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789480114.957449:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d2286ff8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789480114.957454:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2286ff8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789480114.957463:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789480114.957530:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22aea50800 1 00000020:00000080:1.0:1789480114.957538:0:12926:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd14a 00000020:00000080:1.0:1789480114.957546:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22a0282800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789480114.957564:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789480114.957569:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480114.957573:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480114.957577:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d229c7dcd40) has no exports 00000020:00000080:0.0:1789480114.959757:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a0282800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789480115.013657:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480115.013673:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789480115.013680:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22aea55000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480115.013685:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22aea55000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789480115.013694:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789480115.013835:0:12926:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d22aea53800 00000020:01000000:1.0:1789480115.013862:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789480115.013867:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480115.013872:0:12926:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789480115.013877:0:12926:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d229c720000) has no exports 00000100:00100000:1.0:1789480115.013963:0:8260:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d22b23e9a00:8260] 3 exiting: rc = 0 00000100:00100000:2.0:1789480115.014657:0:5832:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d2285fc8400:5832] 2 exiting: rc = 0 00000100:00100000:3.0:1789480115.014937:0:5830:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d2285fc8e00:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1789480115.015835:0:11710:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8d22a168e800:11710] 4 exiting: rc = 0 00000100:00100000:1.0:1789480115.015932:0:5831:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d2285fc9e00:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789480115.016010:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016041:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016049:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016055:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016060:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016066:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016072:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016077:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016082:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016087:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016092:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016098:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016104:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016109:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016115:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016121:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016126:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016131:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016136:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016141:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016148:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016153:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016159:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016164:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016170:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016176:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016181:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016187:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016192:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016198:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016204:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016209:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016214:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016221:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016228:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016233:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016246:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016251:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016257:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016262:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016267:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016273:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016279:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016308:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016315:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016320:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016325:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016330:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016335:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016341:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016346:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016351:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016360:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016366:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016370:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016375:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016381:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016402:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016410:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016416:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016422:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016429:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016436:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.016444:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.024879:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d2285fc9a00:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1789480115.027175:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d2285fc9800:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1789480115.027244:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027254:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027260:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027266:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027271:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027276:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027303:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027310:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027317:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027323:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027328:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027334:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027340:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027344:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027349:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027354:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027359:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027363:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027368:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027373:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027377:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027383:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027387:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027392:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027397:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027401:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027406:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027412:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027416:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027420:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027425:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027429:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027434:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027439:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027444:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027472:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027477:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027482:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027487:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027491:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027496:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027501:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027507:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027512:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027518:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027523:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027529:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027534:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027539:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027544:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027549:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027554:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027560:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027564:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027571:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027577:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027582:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027587:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027593:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027598:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027602:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027608:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027625:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.027631:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028319:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d2290753400:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1789480115.028497:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d22a153ac00:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1789480115.028639:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028646:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028660:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028668:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028675:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028690:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028696:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028715:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028722:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028728:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028734:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028741:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028746:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028755:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028761:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028768:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028773:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028778:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028785:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028806:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028814:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028819:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028826:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028831:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028837:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028843:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028851:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028856:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028861:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028867:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028872:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028894:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028901:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028909:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028935:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028944:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028954:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028960:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028968:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028973:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028987:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.028994:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029003:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029027:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029046:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029053:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029059:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029066:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029073:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029080:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029087:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029093:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029099:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029104:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029111:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029132:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029142:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029147:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029154:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029161:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029168:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029175:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029182:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.029189:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.040216:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d22876d6400:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1789480115.042843:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d229c58c400:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1789480115.053333:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053343:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053349:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053355:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053362:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053378:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053385:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053390:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053395:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053400:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053405:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053420:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053425:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053430:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053435:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053439:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053444:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053449:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053454:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053458:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053463:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053467:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053473:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053478:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053484:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053489:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053494:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053498:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053503:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053507:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053512:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053517:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053522:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053527:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053537:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053542:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053546:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053551:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053557:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053562:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053567:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053572:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053577:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053583:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053588:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053593:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053606:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053612:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053627:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053632:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053637:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053643:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053648:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053653:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053658:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053663:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053668:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053672:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053678:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053682:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053687:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053692:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053697:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.053702:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480115.054074:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d22911ec000:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1789480115.056823:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d22876d7c00:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1789480115.067057:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067067:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067072:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067079:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067086:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067092:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067098:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067104:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067120:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067126:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067234:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067241:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067246:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067252:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067258:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067264:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067270:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067276:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067300:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067308:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067314:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067319:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067325:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067331:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067338:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067343:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067349:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067355:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067360:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067365:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067371:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067377:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067383:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067388:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067393:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067409:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067414:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067420:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067425:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067430:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067436:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067442:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067449:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067454:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067460:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067466:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067471:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067476:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067482:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067487:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067493:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067499:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067505:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067511:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067517:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067523:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067528:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067533:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067539:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067545:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067549:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067555:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067560:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.067566:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480115.068005:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d22a440ec00:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1789480115.068817:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d22a440f000:5842] 1 exiting: rc = 0 00000001:00100000:2.0:1789480115.094322:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789480115.094333:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d2283ead000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480115.094546:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2283ead000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789480115.094603:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2283ea8800 for lustre-OST0001 00000100:00100000:2.0:1789480115.115504:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115513:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115519:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115525:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115529:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115535:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115540:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115545:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115551:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115557:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115562:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115567:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115573:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115578:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115584:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115589:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115594:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115693:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115699:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115705:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115710:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115715:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115721:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115727:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115733:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115738:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115743:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115749:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115754:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115760:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115765:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115770:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115776:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115781:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115786:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115792:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115797:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115803:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115808:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115814:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115819:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115824:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115830:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115835:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115841:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115846:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115851:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115856:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115861:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115867:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115872:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115878:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115891:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115897:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115902:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115907:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115913:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115918:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115924:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115930:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115935:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115941:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115946:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.115952:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480115.117540:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d22a440e000:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1789480115.121844:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d22a440e200:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1789480115.122241:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d22a440e600:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1789480115.122477:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122485:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122491:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122497:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122502:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122508:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122514:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122519:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122524:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122529:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122555:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122562:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122567:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122572:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122581:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122586:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122592:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122598:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122604:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122772:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122782:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122789:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122795:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122818:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122823:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122829:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122835:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122841:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122846:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122852:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122858:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122863:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122869:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122876:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122899:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122907:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122914:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122920:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122928:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122933:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122939:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122945:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122952:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122958:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122963:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122970:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122976:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122981:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122986:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122992:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.122999:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123006:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123012:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123019:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123025:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123046:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123053:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123058:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123088:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123096:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123103:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123110:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123117:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480115.123123:0:12926:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789480115.130347:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480115.130360:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789480115.130366:0:12926:0:(genops.c:885:class_export_put()) final put ffff8d22a483f800/MDS_uuid 00000020:00000080:2.0:1789480115.130370:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a483f800/MDS_uuid for MDS 00000020:01000000:2.0:1789480115.130380:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789480115.130521:0:12926:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789480115.301673:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480116.315628:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480117.339521:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480118.106583:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480118.106608:0:12631:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480118.106611:0:12631:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480118.106620:0:12631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1789480118.106627:0:12631:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789480118.106640:0:12631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2185560000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480118.106666:0:12631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab47480 x1876405551980928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480118.106682:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480118.106685:0:12631:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480118.106687:0:12631:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480118.106690:0:12631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1789480118.106693:0:12631:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789480118.106698:0:12631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d229c50f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480118.106709:0:12631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab46680 x1876405551981056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480118.115527:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480118.115566:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551980800:0@lo:400:kworker.0 00000400:00000100:3.0:1789480118.115648:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405551980800 offset 0 length 224: 4 00000100:00100000:2.0:1789480118.115981:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551980928:0@lo:38:kworker.0 00000400:00000100:2.0:1789480118.116010:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405551980928 offset 0 length 520: 4 00000100:00100000:2.0:1789480118.116028:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551981056:0@lo:38:kworker.0 00000400:00000100:2.0:1789480118.116045:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405551981056 offset 0 length 520: 4 00010000:00010000:3.0:1789480118.362433:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789480118.375185:0:13081:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789480118.399025:0:13081:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789480118.399694:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.399711:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.399718:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.399725:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.399745:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789480118.399762:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789480118.400222:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480118.400235:0:13081:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab47480 x1876405551980928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480118.400256:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789480118.400262:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789480118.400268:0:13081:0:(import.c:65:import_set_state_nolock()) ffff8d2185560000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789480118.400273:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480118.400277:0:13081:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab47480 x1876405551980928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480133 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480118.400303:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789480118.400306:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789480118.400407:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480118.400415:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.400424:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5c00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480118.400428:0:11176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.400437:0:11176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480118.400456:0:11176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480118.400462:0:11176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480118.400465:0:11176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789480118.400467:0:11176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789480118.400507:0:11176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.400514:0:11176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789480118.400891:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551980928:0@lo:38:kworker.0 00010000:00010000:0.0:1789480118.402111:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.402123:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5c00/0xbb972366037fd48b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.402138:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480118.402140:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480118.402142:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480118.402150:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480118.402166:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551981184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480118.402240:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480118.402337:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981184 00000100:00100000:0.0:1789480118.402345:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981184 00000100:00100000:0.0:1789480118.402391:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480118.402400:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3298:x1876405551981184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789480118.402405:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480118 with bad export cookie 13517311727628177780 00010000:00010000:2.0:1789480118.405328:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405349:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405356:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405363:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405378:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480118.405384:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405391:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405410:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405415:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480118.405429:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789480118.405434:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789480118.405458:0:13081:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789480118.405463:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789480118.405468:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480118.405474:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789480118.405478:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d21852a99c0) has no exports 00000020:00080000:2.0:1789480118.405504:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d21852a99c0) has no exports 00010000:00010000:1.0:1789480118.406743:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480118.406761:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406782:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280031200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480118.406785:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406794:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480118.406800:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480118.406818:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789480118.406825:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789480118.406827:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789480118.406869:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406880:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480118.406916:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406923:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280031200/0xbb972366037fd4a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd4a7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406939:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480118.406942:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406948:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7a00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480118.406950:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.406956:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480118.406975:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480118.406980:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789480118.406982:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789480118.406984:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789480118.407004:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.407010:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480118.407016:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.407022:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e7a00/0xbb972366037fd6c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb972366037fd6d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480118.407030:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480118.407032:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480118.407034:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480118.407052:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551981312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480118.407124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480118.407174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480118.407181:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551981440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480118.407310:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480118.407348:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981312 00000100:00100000:1.0:1789480118.407356:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981312 00000100:00100000:1.0:1789480118.407388:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981440 00000100:00100000:1.0:1789480118.407391:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981440 00000100:00100000:1.0:1789480118.407415:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480118.407423:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1876405551981312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789480118.407429:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480118 with bad export cookie 13517311727628177780 00000100:00100000:1.0:1789480118.407475:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1876405551981312:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (350us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480118.407481:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480118.407497:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480118.407501:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1876405551981440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789480118.407511:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480118 with bad export cookie 13517311727628177780 00000100:00100000:1.0:1789480118.407538:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1876405551981440:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (227us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480118.407544:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789480118.407586:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789480118.407590:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d22a483f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789480118.407594:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789480118.408833:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789480118.412002:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2285f87360 - data ffff8d22bfe7ae58/ffff8d21854d8800 00000020:01000000:2.0:1789480118.412169:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2290a3b0c0 - data ffff8d229cb0f0d8/ffff8d218566a400 00000100:00100000:0.0:1789480118.417212:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3298:x1876405551981184:12345-0@lo:103:ldlm_bl.0 Request processed in 14805us (14965us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789480118.417241:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789480118.417914:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789480118.431845:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789480118.431852:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789480118.431863:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab44e00 x1876405551980800/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789480134 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480118.431955:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187732d80 x1876405551981184/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480134 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480118.431976:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab47100 x1876405551981312/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480134 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480118.431985:0:3300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab45500 x1876405551981440/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480134 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789480118.431994:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789480118.431997:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789480118.431999:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789480118.432045:0:3298:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d22a483f000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789480118.432063:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e677fecc-98d9-457e-99be-c06439303d19:3298:1876405551981184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480118.433327:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e677fecc-98d9-457e-99be-c06439303d19:3299:1876405551980800:0@lo:400:kworker.0 00000100:00080000:1.0:1789480118.433698:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d22a483f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480118.433705:0:3300:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:1.0:1789480118.433719:0:3300:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8d22a483f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480118.433990:0:3300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187730a80 x1876405551981568/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480118.434048:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e677fecc-98d9-457e-99be-c06439303d19:3297:1876405551981568:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789480118.434096:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405551981568 offset 0 length 520: 4 00000100:00100000:0.0:1789480118.434153:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551981312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480118.434167:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e677fecc-98d9-457e-99be-c06439303d19:3300:1876405551981440:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1789480118.460961:0:13081:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789480118.484123:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd2a8 00000020:00000080:0.0:1789480118.484133:0:13081:0:(genops.c:885:class_export_put()) final put ffff8d22a4534000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789480118.484152:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22a4535800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789480118.484156:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22a4535800 2 00000020:01000004:0.0:1789480118.484160:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d22a4535800 from lustre-OST0000 00000020:00000080:0.0:1789480118.484182:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.484192:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789480118.484195:0:13081:0:(genops.c:885:class_export_put()) final put ffff8d229c50e800/lustre-OST0000_UUID 00000020:00000080:0.0:1789480118.484197:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789480118.484206:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789480118.484245:0:13081:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789480118.484248:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789480118.484251:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480118.484256:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480118.484263:0:13081:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d22aeb4b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480118.484269:0:13081:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8d22b99c0000) has exports, disconnecting them 00000020:00080000:0.0:1789480118.484274:0:13081:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d22aeb4b000), last request at 1789479882 00000020:00000080:0.0:1789480118.484277:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd2d2 00000020:00000080:3.0:1789480118.484645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4534000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1789480118.484705:0:13081:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d22aeb4b000): rc 0 00000020:00000080:0.0:1789480118.484723:0:13081:0:(genops.c:885:class_export_put()) final put ffff8d22aeb4b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789480118.485984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22aeb4b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789480118.486398:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789480118.486403:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480118.486408:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789480118.486413:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480118.486595:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480118.486603:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789480118.486610:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22a4535800 1 00000020:00000080:2.0:1789480118.486617:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd262 00000020:00000080:2.0:1789480118.486624:0:13081:0:(genops.c:885:class_export_put()) final put ffff8d22ba11b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789480118.486629:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789480118.486634:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480118.486637:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480118.486641:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d229c724d40) has no exports 00000020:00000080:3.0:1789480118.486879:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2185560000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789480118.486886:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2185563000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789480118.486888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2185563000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789480118.486896:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789480118.486955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22ba11b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789480118.524647:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480118.524665:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789480118.524671:0:13081:0:(genops.c:885:class_export_put()) final put ffff8d22aeb4a000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789480118.524676:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22aeb4a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789480118.524692:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789480118.524947:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d22a0283800 00000020:02000400:2.0:1789480118.525009:0:13081:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789480119.386373:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480120.413938:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480121.434543:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789480121.929115:0:13231:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789480121.952736:0:13231:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789480121.952836:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.952855:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.952887:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.952905:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.952935:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789480121.952943:0:13231:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789480121.952974:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480121.952990:0:13231:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab46680 x1876405551981056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480133 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480121.953013:0:13231:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789480121.953021:0:13231:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789480121.953029:0:13231:0:(import.c:65:import_set_state_nolock()) ffff8d229c50f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789480121.953035:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480121.953039:0:13231:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d22bab46680 x1876405551981056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480133 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480121.953046:0:13231:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789480121.953050:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1789480121.953186:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551981056:0@lo:38:kworker.0 00010000:00010000:0.0:1789480121.953489:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480121.953499:0:11176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.953509:0:11176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2280030800 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480121.953514:0:11176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.953524:0:11176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480121.953531:0:11176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480121.953537:0:11176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480121.953540:0:11176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789480121.953543:0:11176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789480121.953560:0:11176:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22a483f000 00010000:00010000:0.0:1789480121.953565:0:11176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.953574:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d2280030800/0xbb972366037fd46f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.953587:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480121.953589:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480121.953590:0:11176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480121.955441:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955470:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955477:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955510:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955543:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480121.955551:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955559:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955566:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955572:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480121.955591:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789480121.955598:0:13231:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789480121.955633:0:13231:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789480121.955639:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789480121.955644:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480121.955652:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789480121.955657:0:13231:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d22a4ac99c0) has no exports 00000020:00080000:3.0:1789480121.955689:0:13231:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d22a4ac99c0) has no exports 00010000:00010000:0.0:1789480121.956784:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480121.956799:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.956831:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffc00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480121.956836:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.956918:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480121.956929:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480121.956935:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480121.956938:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789480121.956941:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789480121.956962:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22a483f000 00010000:00010000:0.0:1789480121.956966:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.956974:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bafffc00/0xbb972366037fd47d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.956995:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480121.956998:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.957257:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6400 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:0.0:1789480121.957261:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.957269:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480121.957304:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480121.957309:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789480121.957311:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789480121.957313:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789480121.957321:0:5817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22a483f000 00010000:00010000:0.0:1789480121.957324:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.957330:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6400/0xbb972366037fd6bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd6c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480121.957347:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480121.957349:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480121.957351:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480121.957844:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789480121.958372:0:13231:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2285f87000 - data ffff8d229cab4510/ffff8d22bad6f800 00000020:01000000:3.0:1789480121.958708:0:13231:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2285f87f60 - data ffff8d22bfe76360/ffff8d21854dac00 00100000:10000000:3.0:1789480121.980024:0:13231:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789480122.020487:0:13231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd373 00000020:00000080:0.0:1789480122.020740:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d22bd6d0800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789480122.020759:0:13231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22b9aa2800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789480122.020763:0:13231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22b9aa2800 2 00000020:01000004:0.0:1789480122.020767:0:13231:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d22b9aa2800 from lustre-OST0001 00000020:00000080:0.0:1789480122.020804:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480122.020817:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789480122.020820:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d22bd6d6000/lustre-OST0001_UUID 00000020:00000080:0.0:1789480122.020824:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bd6d6000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789480122.020834:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789480122.021021:0:13231:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e677fecc-98d9-457e-99be-c06439303d19->MGS 00010000:00010000:0.0:1789480122.021045:0:13231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480122.021079:0:13231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.021086:0:13231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789480122.021090:0:13231:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789480122.021094:0:13231:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789480122.021116:0:13231:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22a483f000 00010000:00010000:0.0:1789480122.021121:0:13231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22813d2400/0xbb972366037fd285 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd28c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.021140:0:13231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480122.021147:0:13231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.021153:0:13231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480122.021155:0:13231:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789480122.021156:0:13231:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789480122.021169:0:13231:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d22a483f000 00010000:00010000:0.0:1789480122.021172:0:13231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22baffea00/0xbb972366037fd4d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb972366037fd4d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480122.021190:0:13231:0:(import.c:65:import_set_state_nolock()) ffff8d22a483f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789480122.021195:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789480122.021198:0:13231:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789480122.021200:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789480122.021205:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789480122.021222:0:13231:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2187730a80 x1876405551981568/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789480128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1789480122.021359:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bd6d0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789480122.021425:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789480122.021429:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1789480122.021909:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e677fecc-98d9-457e-99be-c06439303d19:3297:1876405551981568:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1789480122.021989:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789480122.022002:0:13231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd166 00000020:00000080:0.0:1789480122.022010:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d22a483e000/e677fecc-98d9-457e-99be-c06439303d19 00000020:01000000:0.0:1789480122.022029:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:0.0:1789480122.022035:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480122.022043:0:13231:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789480122.022047:0:13231:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d229c723380) has no exports 00000020:00000080:2.0:1789480122.022099:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a483e000/e677fecc-98d9-457e-99be-c06439303d19 for MGC192.168.204.154@tcp 10000000:01000000:1.0:1789480122.022144:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789480122.022252:0:13231:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:0.0:1789480122.022255:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789480122.022259:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789480122.022262:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789480122.022264:0:13231:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789480122.022418:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480122.022426:0:13231:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid e677fecc-98d9-457e-99be-c06439303d19) 00000020:01000000:0.0:1789480122.022432:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789480122.022435:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480122.022440:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480122.022446:0:13231:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2186b3e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480122.022451:0:13231:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8d22a4acb380) has exports, disconnecting them 00000020:00080000:0.0:1789480122.022457:0:13231:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2186b3e000), last request at 1789479905 00000020:00000080:0.0:1789480122.022462:0:13231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd39d 00000020:00080000:0.0:1789480122.022473:0:13231:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2186b3e000): rc 0 00000020:00000080:0.0:1789480122.022490:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d2186b3e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789480122.022854:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d22a483f000 for MGC192.168.204.154@tcp 00000020:00000080:2.0:1789480122.022862:0:12631:0:(genops.c:885:class_export_put()) final put ffff8d22a4839800/e677fecc-98d9-457e-99be-c06439303d19 00000020:00000080:2.0:1789480122.022864:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22a4839800/e677fecc-98d9-457e-99be-c06439303d19 for MGC192.168.204.154@tcp 00000020:01000000:2.0:1789480122.022874:0:12631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (e677fecc-98d9-457e-99be-c06439303d19) 00000020:00000080:2.0:1789480122.023354:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789480122.024363:0:13231:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789480122.024389:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480122.024395:0:13231:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789480122.024404:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480122.024506:0:12631:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d229c50f000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789480122.025132:0:11176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789480122.025542:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789480122.026116:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789480122.026354:0:5812:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d2291dd5600:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1789480122.027447:0:11175:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d22bd7c2200:11175] 2 exiting: rc = 0 00000100:00100000:1.0:1789480122.028376:0:5813:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d2291dd5400:5813] 1 exiting: rc = 0 00000100:00100000:2.0:1789480122.028581:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.029220:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d2285fc1400:5816] 2 exiting: rc = 0 00000100:00100000:1.0:1789480122.029337:0:5814:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2292499800:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1789480122.029413:0:8452:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d22a4a84200:8452] 3 exiting: rc = 0 00000100:00100000:1.0:1789480122.029480:0:8453:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8d2185160000:8453] 4 exiting: rc = 0 00000100:00100000:0.0:1789480122.041216:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d2285fc1600:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1789480122.041760:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041770:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041777:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041784:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041791:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041798:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041806:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041829:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041835:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041843:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041929:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041937:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041944:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041952:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041959:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041966:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041987:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.041995:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042000:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042006:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042013:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042019:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042027:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042033:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042038:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042044:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042049:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042055:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042061:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042067:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042073:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042079:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042085:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042091:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042098:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042104:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042110:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042117:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042122:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042128:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042132:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042138:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042152:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042158:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042163:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042169:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042174:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042180:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042185:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042191:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042196:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042202:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042207:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042213:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042219:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042226:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042231:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042237:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042242:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042248:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042253:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042260:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042266:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.042272:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789480122.045079:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480122.045097:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789480122.045104:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d2186b3a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789480122.045110:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2186b3a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789480122.045118:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789480122.045178:0:13231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22b9aa2800 1 00000020:00000080:2.0:1789480122.045186:0:13231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fd342 00000020:00000080:2.0:1789480122.045195:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d229c50c800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789480122.045218:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789480122.045232:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480122.045238:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480122.045242:0:13231:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d22a4accd40) has no exports 00000020:00000080:0.0:1789480122.045469:0:12631:0:(genops.c:844:class_export_destroy()) destroying export ffff8d229c50c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789480122.068579:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.068605:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789480122.068612:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d22bd6d6800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789480122.068619:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22bd6d6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789480122.068637:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789480122.068934:0:13231:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d22bd6d2800 00000020:01000000:1.0:1789480122.068969:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789480122.068974:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.068980:0:13231:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789480122.068985:0:13231:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d22b99c3380) has no exports 00000020:00000080:1.0:1789480122.069024:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.069044:0:13231:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789480122.069048:0:13231:0:(genops.c:885:class_export_put()) final put ffff8d22ba11e000/OSS_uuid 00000020:00000080:1.0:1789480122.069050:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff8d22ba11e000/OSS_uuid for OSS 00000020:01000000:1.0:1789480122.069054:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789480122.069168:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d22b9f3b000:6687] 2 exiting: rc = 0 00000100:00100000:1.0:1789480122.069343:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d22c1e62600:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1789480122.069403:0:8279:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d22bab07800:8279] 3 exiting: rc = 0 00000100:00080000:0.0:1789480122.069710:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789480122.069870:0:12025:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8d22a48e1a00:12025] 4 exiting: rc = 0 00000100:00100000:3.0:1789480122.070777:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d229c768a00:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1789480122.076376:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076392:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076405:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076414:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076420:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076426:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076449:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076455:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076461:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076468:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076485:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.076491:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077032:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077044:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077050:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077056:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077063:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077069:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077074:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077081:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077087:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077093:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077099:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077104:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077109:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077116:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077127:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077136:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077142:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077147:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077153:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077162:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077171:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077184:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077193:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077199:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077209:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077214:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077231:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077250:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077258:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077274:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077318:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077325:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077331:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077336:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077343:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077350:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077356:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077362:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077368:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077374:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077379:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077386:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077392:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077398:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077403:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077408:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077413:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077418:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077424:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077430:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077435:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.077447:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480122.079463:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d22b9f75200:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1789480122.079639:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d22b9f74600:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1789480122.080066:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080078:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080085:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080092:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080098:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080104:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080111:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080117:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080124:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080130:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080138:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080144:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080162:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080168:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080175:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080181:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080187:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080195:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080201:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080209:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080215:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080221:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080227:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080233:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080239:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080246:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080254:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080260:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080266:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080272:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080278:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080322:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080329:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080336:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080342:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080348:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080354:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080360:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080366:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080372:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080378:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080384:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080392:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080397:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080403:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080409:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080415:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080429:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080434:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080440:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080445:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080451:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080457:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080462:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080468:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080483:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080489:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080502:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080509:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080515:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080521:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080527:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080533:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.080550:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.083522:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d22a15bca00:6693] 2 exiting: rc = 0 00000100:00100000:0.0:1789480122.084049:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d22b9f3b200:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1789480122.085022:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d22b9f75400:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789480122.085141:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085151:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085158:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085165:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085172:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085180:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085187:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085195:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085202:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085208:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085216:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085236:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085243:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085250:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085257:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085262:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085268:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085745:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085753:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085760:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085768:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085795:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085803:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085811:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085818:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085825:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085832:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085839:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085845:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085922:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085932:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085939:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085945:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085951:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085957:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085963:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085970:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085978:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085984:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085991:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.085999:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086007:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086014:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086022:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086030:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086052:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086061:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086068:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086074:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086082:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086090:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086097:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086118:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086126:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086135:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086143:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086150:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086157:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086163:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086169:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086175:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086182:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086188:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.086195:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.098772:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d22a4928600:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1789480122.098933:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d22a4929800:6694] 0 exiting: rc = 1 00000100:00100000:0.0:1789480122.099175:0:6817:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff8d229c7a1400:6817] 2 exiting: rc = 0 00000100:00100000:2.0:1789480122.099360:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099369:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099376:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099381:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099386:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099392:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099398:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099403:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099409:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099415:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099420:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099431:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099438:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099443:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099449:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099455:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099460:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099466:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099472:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099478:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099485:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099491:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099497:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099503:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099508:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099514:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099519:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099525:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099531:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099536:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099543:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099566:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099582:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099588:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099594:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099600:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099605:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099610:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099616:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099621:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099625:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099632:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099637:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099643:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099648:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099653:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099659:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099664:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099669:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099676:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099682:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099687:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099692:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099697:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099702:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099707:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099712:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099717:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099722:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099727:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099732:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099739:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099744:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.099749:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480122.100821:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d22ba7a2c00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1789480122.101691:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d22ba7a3000:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1789480122.102050:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102062:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102078:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102086:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102093:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102100:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102109:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102116:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102123:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102129:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102136:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102153:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102162:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102169:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102176:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102184:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102192:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102199:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102207:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102214:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102394:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102405:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102413:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102434:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102443:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102450:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102457:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102464:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102471:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102489:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102657:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102668:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102675:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102681:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102688:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102708:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102716:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102728:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102735:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102741:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102748:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102755:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102762:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102768:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102775:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102782:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102788:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102806:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102813:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102820:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102826:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102833:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102840:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102918:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102928:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102938:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102944:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102949:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102955:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102976:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102984:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.102994:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.103000:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.103013:0:13231:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789480122.135543:0:13231:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789480143.712329:0:13848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789480155.094964:0:14308:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789480155.094971:0:14308:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789480155.095087:0:14308:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2187178000 00000020:01000004:3.0:1789480155.095103:0:14308:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789480155.095112:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789480155.095125:0:14308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d22a4ac8000) 00000020:00000080:3.0:1789480155.095138:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789480155.118137:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789480155.125187:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789480155.128729:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1789480155.128948:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1789480155.129139:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789480155.129882:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:2.0:1789480155.130011:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1789480155.130128:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1789480155.131464:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1789480155.131777:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1789480155.138903:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 513: rc = 0 00100000:10000000:2.0:1789480155.139020:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 513: rc = 0 00100000:10000000:3.0:1789480155.140564:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1789480155.141515:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1789480155.141890:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.142137:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.142772:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:3.0:1789480155.143018:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.143442:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.143733:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1789480155.143988:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.144484:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1789480155.144735:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1789480155.144983:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1789480155.145579:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 778: rc = 0 00100000:10000000:3.0:1789480155.145841:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 778: rc = 0 00100000:10000000:3.0:1789480155.146100:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 778: rc = 0 00100000:10000000:3.0:1789480155.147070:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 778: rc = 0 00100000:10000000:3.0:1789480155.147584:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 778: rc = 0 00100000:10000000:3.0:1789480155.147833:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 778: rc = 0 00100000:10000000:3.0:1789480155.148078:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 778: rc = 0 00100000:10000000:3.0:1789480155.148594:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 778: rc = 0 00100000:10000000:3.0:1789480155.149073:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 778: rc = 0 00100000:10000000:3.0:1789480155.149525:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 778: rc = 0 00100000:10000000:3.0:1789480155.149736:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 778: rc = 0 00100000:10000000:3.0:1789480155.149969:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 778: rc = 0 00100000:10000000:3.0:1789480155.150231:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 778: rc = 0 00100000:10000000:3.0:1789480155.150752:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 778: rc = 0 00100000:10000000:3.0:1789480155.151013:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 778: rc = 0 00100000:10000000:3.0:1789480155.151443:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 778: rc = 0 00100000:10000000:3.0:1789480155.151691:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 778: rc = 0 00100000:10000000:3.0:1789480155.151963:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 778: rc = 0 00100000:10000000:3.0:1789480155.152230:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 778: rc = 0 00100000:10000000:3.0:1789480155.152751:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 778: rc = 0 00100000:10000000:3.0:1789480155.153005:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 778: rc = 0 00100000:10000000:3.0:1789480155.153419:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 778: rc = 0 00100000:10000000:3.0:1789480155.153715:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 778: rc = 0 00100000:10000000:3.0:1789480155.153975:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 778: rc = 0 00100000:10000000:3.0:1789480155.154228:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 778: rc = 0 00100000:10000000:3.0:1789480155.155112:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 778: rc = 0 00100000:10000000:3.0:1789480155.155533:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 778: rc = 0 00100000:10000000:3.0:1789480155.155760:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 778: rc = 0 00100000:10000000:3.0:1789480155.156012:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 778: rc = 0 00100000:10000000:3.0:1789480155.156619:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 778: rc = 0 00100000:10000000:3.0:1789480155.156862:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 778: rc = 0 00100000:10000000:3.0:1789480155.157104:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 778: rc = 0 00100000:10000000:3.0:1789480155.157647:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 483: rc = 0 00100000:10000000:3.0:1789480155.158148:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789480155.158849:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 514: rc = 0 00100000:10000000:3.0:1789480155.159052:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789480155.159122:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 514: rc = 0 00100000:10000000:3.0:1789480155.159489:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789480155.159561:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 514: rc = 0 00100000:10000000:3.0:1789480155.159924:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789480155.159998:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 518: rc = 0 00100000:10000000:3.0:1789480155.160179:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789480155.160692:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 518: rc = 0 00100000:10000000:3.0:1789480155.160879:0:14308:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789480155.160948:0:14308:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 518: rc = 0 00000020:00000080:3.0:1789480155.161373:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789480155.161382:0:14308:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789480155.161393:0:14308:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe459 00000020:01000004:3.0:1789480155.161402:0:14308:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789480155.161407:0:14308:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789480155.161412:0:14308:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2187178000 from MGS 00000020:01000004:3.0:1789480155.161416:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789480155.161427:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d22a4accd40) 00000020:00000080:3.0:1789480155.161436:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789480155.161492:0:14308:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2187178000 from MGS, refs=2 00080000:01000000:3.0:1789480155.161497:0:14308:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789480155.161502:0:14308:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe467 00000100:00100000:3.0:1789480155.161602:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789480155.161741:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789480155.161749:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789480155.162767:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789480155.162852:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789480155.164048:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480155.164364:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789480155.164372:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789480155.165622:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789480155.165632:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789480155.166550:0:14308:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789480155.166561:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789480155.167688:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.167693:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.167695:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.168145:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.168154:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.168156:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480155.169746:0:14308:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789480155.174425:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789480155.181748:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789480155.181767:0:14308:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789480155.181770:0:14308:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789480155.184320:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789480155.184475:0:14308:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789480155.184571:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789480155.185035:0:14308:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789480155.185973:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480155.186268:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789480155.186276:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789480155.189819:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789480155.189833:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789480155.190166:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789480155.190173:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789480155.191095:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789480155.191116:0:14308:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1789480155.191118:0:14308:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789480155.191147:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:3.0:1789480155.191160:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff8d22a4acb380) 00000020:00000080:3.0:1789480155.191175:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789480155.191483:0:14308:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2291db8000@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1789480155.191634:0:14308:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1789480155.191639:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789480155.193700:0:14324:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789480155.193756:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3) 00000020:00000080:0.0:1789480155.193777:0:14308:0:(genops.c:1384:class_connect()) connect: client b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3, cookie 0xbb972366037fe475 00000100:00080000:0.0:1789480155.193789:0:14308:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480155.193801:0:14308:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8d2291db8000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480155.193835:0:14308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187732300 x1876405551981696/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480155.193855:0:14308:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3->MGS 00000020:01000004:0.0:1789480155.193874:0:14308:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789480155.193898:0:14308:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789480155.193911:0:14308:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d22b99c4d40) 00000020:00000080:0.0:1789480155.193922:0:14308:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789480155.194967:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3297:1876405551981696:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789480155.195043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480155.195140:0:14322:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789480155.204942:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981696 00000100:00100000:2.0:1789480155.204958:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981696 00000100:00100000:2.0:1789480155.205687:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480155.205697:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876405551981696:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789480155.205727:0:14318:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1789480155.205761:0:14318:0:(genops.c:1384:class_connect()) connect: client b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3, cookie 0xbb972366037fe483 00000100:00080000:2.0:1789480155.205903:0:14318:0:(import.c:65:import_set_state_nolock()) ffff8d21876d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480155.206014:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:3297:x1876405551981696:12345-0@lo:250:mount.lustre.0 Request processed in 317us (10970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.206023:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480155.206091:0:3297:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789480155.206100:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:2.0:1789480155.206109:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789480155.206113:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789480155.206117:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2291db8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789480155.206119:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789480155.206129:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789480155.206135:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3297:1876405551981696:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789480155.214506:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480155.214689:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789480155.214697:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789480155.217691:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789480155.217706:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789480155.218770:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789480155.218779:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789480155.220064:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480155.221445:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789480155.221455:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789480155.230140:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789480155.230155:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789480155.286528:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480155.286735:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789480155.286742:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789480155.291649:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789480155.291665:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789480155.298121:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480155.298556:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480155.298563:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789480155.299961:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480155.299973:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789480155.302707:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480155.303130:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480155.303138:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789480155.304542:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480155.304553:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789480155.305786:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480155.306104:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480155.306110:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789480155.307534:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480155.307545:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789480155.338689:0:14308:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480155.338891:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789480155.338898:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789480155.342101:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789480155.342116:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789480155.343863:0:14308:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789480155.343877:0:14308:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789480155.345766:0:14308:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789480155.345790:0:14308:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789480155.345798:0:14308:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789480155.345960:0:14308:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789480155.346004:0:14308:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789480155.346009:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789480155.346010:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789480155.346012:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480155.346013:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480155.346014:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480155.346015:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480155.346017:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789480155.346018:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789480155.346020:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480155.346021:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480155.346024:0:14308:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789480155.346027:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789480155.346028:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789480155.346029:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480155.346030:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480155.346031:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480155.346032:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480155.346033:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789480155.346034:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789480155.346035:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480155.346036:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480155.346065:0:14308:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789480155.346091:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551981824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789480155.346165:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.346243:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480155.346356:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981824 00000100:00100000:1.0:1789480155.346364:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981824 00000100:00100000:1.0:1789480155.346411:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480155.346420:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:14308:x1876405551981824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789480155.346471:0:14321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789480155.346475:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789480155.346478:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789480155.347111:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789480155.347513:0:14321:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789480155.348973:0:14343:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789480155.348979:0:14343:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789480155.348982:0:14343:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789480155.349164:0:14343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789480155.349843:0:14321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789480155.349857:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789480155.363316:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:14308:x1876405551981824:12345-0@lo:253:mount.lustre.0 Request processed in 16855us (17109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.363337:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480155.366189:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551981824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789480155.366211:0:14308:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789480155.366214:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789480155.366216:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480155.366217:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480155.366218:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480155.366220:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480155.366221:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480155.366222:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480155.366223:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480155.366225:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480155.366227:0:14308:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789480155.366263:0:14308:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2187178000 from lustre-MDT0000 10000000:01000000:2.0:1789480155.366319:0:14308:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789480155.366323:0:14308:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789480155.366328:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d22a4acb380 10000000:01000000:2.0:1789480155.366332:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480155.366341:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d22a4acb380 from 1 10000000:01000000:2.0:1789480155.366344:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789480155.366386:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.366398:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.366408:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480155.366430:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551981952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480155.366512:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.366564:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283fe3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480155.366653:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551981952 00000100:00100000:1.0:1789480155.366660:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551981952 00000100:00100000:1.0:1789480155.366708:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480155.366718:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:14308:x1876405551981952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480155.366732:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480155.366746:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39dc00/0xbb972366037fe491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe48a expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480155.366767:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39dc00/0xbb972366037fe491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe48a expref: 6 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480155.366777:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39dc00/0xbb972366037fe491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe48a expref: 6 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480155.366793:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39dc00, rc 0) 00000100:00100000:1.0:1789480155.366846:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+6:14308:x1876405551981952:12345-0@lo:101:mount.lustre.0 Request processed in 131us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480155.366854:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480155.367135:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551981952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480155.367148:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.367158:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480155.367206:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480155.367231:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.367264:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283fe3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480155.367416:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982080 00000100:00100000:1.0:1789480155.367421:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982080 00000100:00100000:1.0:1789480155.367454:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480155.367461:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+6:14308:x1876405551982080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480155.367767:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+6:14308:x1876405551982080:12345-0@lo:501:mount.lustre.0 Request processed in 305us (534us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480155.367775:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480155.367941:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789480155.367976:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789480155.367995:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368003:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480155.368011:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2187178000 10000000:01000000:3.0:1789480155.368015:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789480155.368019:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2187178000 10000000:01000000:3.0:1789480155.368021:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789480155.368024:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2187178000 from 1 10000000:01000000:3.0:1789480155.368026:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789480155.368048:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368055:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368064:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.368077:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480155.368105:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.368175:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.368330:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982208 00000100:00100000:2.0:1789480155.368335:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982208 00000100:00100000:2.0:1789480155.368360:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480155.368367:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+6:14308:x1876405551982208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480155.368375:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480155.368386:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bafff000/0xbb972366037fe49f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe498 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.368403:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bafff000/0xbb972366037fe49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe498 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.368414:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bafff000/0xbb972366037fe49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe498 expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.368420:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bafff000, rc 0) 00000100:00100000:2.0:1789480155.368453:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+7:14308:x1876405551982208:12345-0@lo:101:mount.lustre.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.368465:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480155.368595:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480155.368606:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368624:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480155.368639:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789480155.368745:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368753:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5600/0xbb972366037fe498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe49f expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480155.368759:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789480155.368764:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480155.368768:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2187178000 10000000:01000000:3.0:1789480155.368771:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789480155.368774:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789480155.368776:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789480155.368791:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368797:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.368804:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.368816:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480155.368855:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.368883:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.369103:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982336 00000100:00100000:0.0:1789480155.369108:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982336 00000100:00100000:0.0:1789480155.369146:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789480155.369154:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+7:14308:x1876405551982336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480155.369162:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480155.369178:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7400/0xbb972366037fe4ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe4a6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.369194:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7400/0xbb972366037fe4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe4a6 expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.369202:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7400/0xbb972366037fe4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe4a6 expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.369210:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7400, rc 0) 00000100:00100000:0.0:1789480155.369255:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+8:14308:x1876405551982336:12345-0@lo:101:mount.lustre.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.369261:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480155.369530:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480155.369542:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.369550:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.369596:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480155.369620:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.369637:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.369683:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982464 00000100:00100000:0.0:1789480155.369688:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982464 00000100:00100000:0.0:1789480155.369727:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480155.369734:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+8:14308:x1876405551982464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480155.370332:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14308:x1876405551982464:12345-0@lo:501:mount.lustre.0 Request processed in 597us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.370341:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480155.370451:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480155.370485:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480155.370522:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.370544:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.371007:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982592 00000100:00100000:0.0:1789480155.371015:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982592 00000100:00100000:0.0:1789480155.371056:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480155.371065:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14308:x1876405551982592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480155.372474:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14308:x1876405551982592:12345-0@lo:503:mount.lustre.0 Request processed in 1405us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.372486:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480155.372605:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551982592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480155.374605:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14344:1876405551982720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480155.374679:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.374713:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.374781:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551982720 00000100:00100000:0.0:1789480155.374797:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551982720 00000100:00100000:0.0:1789480155.374856:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789480155.374866:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14344:x1876405551982720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480155.375213:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14344:x1876405551982720:12345-0@lo:502:llog_process_th.0 Request processed in 348us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.375221:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789480155.375441:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14344:1876405551982720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480155.375472:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480155.375485:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.375488:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789480155.375493:0:14344:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789480155.375497:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480155.375512:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d22a4ac99c0) 00000020:00000080:3.0:1789480155.375534:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789480155.375547:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789480155.375624:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789480155.375632:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe4bb 00000020:00000080:3.0:1789480155.375856:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789480155.375860:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.375864:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.375865:0:14344:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789480155.375868:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480155.375871:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.375872:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789480155.375876:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480155.375894:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d22bcb03380) 00000020:00000080:3.0:1789480155.375905:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789480155.375910:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789480155.375913:0:14344:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789480155.375916:0:14344:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789480155.375921:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789480155.375966:0:14344:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2187178000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789480155.375980:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d22bcb00000) 00000020:00000080:3.0:1789480155.375988:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789480155.376035:0:14344:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789480155.376040:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fe4d0 00000020:00000080:3.0:1789480155.376133:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789480155.376139:0:14344:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789480155.376144:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb972366037fe4d7 00080000:01000000:3.0:1789480155.376148:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789480155.376155:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe4de 00010000:00010000:3.0:1789480155.519303:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789480155.519768:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1789480155.530471:0:14344:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789480155.537513:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d22bd6b4d40) 00000020:00000080:1.0:1789480155.537578:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789480155.537663:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789480155.537675:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe4ec 00000020:00000080:0.0:1789480155.541861:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789480155.565063:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb972366037fe4f3 00000020:00000080:0.0:1789480155.566069:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789480155.566081:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480155.566221:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480155.566224:0:14344:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789480155.566230:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480155.566238:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480155.566240:0:14344:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789480155.566256:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789480155.566333:0:14344:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789480155.566354:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480155.566358:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480155.566360:0:14344:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789480155.566362:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789480155.566372:0:14344:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789480155.566374:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480155.566376:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480155.566378:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789480155.566381:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480155.566382:0:14344:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789480155.566385:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789480155.566388:0:14344:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789480155.566391:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480155.566393:0:14344:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789480155.566413:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789480155.566419:0:14344:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1789480155.566447:0:14344:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789480155.566450:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480155.566467:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d22bd6b19c0) 00000020:00000080:1.0:1789480155.566483:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789480155.566500:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789480155.566579:0:14344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789480155.566586:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789480155.566592:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe501 00010000:00080000:1.0:1789480155.566634:0:14344:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2186b38800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789480155.567015:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789480155.567462:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789480155.567506:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789480155.571134:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480155.571222:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789480155.571911:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789480155.573057:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789480155.573063:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789480155.576662:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789480155.576680:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789480155.576853:0:14344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789480155.576876:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fe508 00000100:00080000:3.0:1789480155.576888:0:14344:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480155.576901:0:14344:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2186b38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789480155.576939:0:14344:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd682680 x1876405551982848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789480155.576964:0:14344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789480155.577035:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.577039:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.577041:0:14344:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789480155.577044:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789480155.577047:0:14344:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789480155.577049:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480155.577050:0:14344:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480155.577051:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789480155.577053:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.577055:0:14344:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789480155.577057:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789480155.577061:0:14344:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789480155.577065:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.577066:0:14344:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789480155.577069:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789480155.577072:0:14344:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1789480155.577094:0:14344:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789480155.577097:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480155.577109:0:14344:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d22bcb04d40) 00000020:00000080:3.0:1789480155.577121:0:14344:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789480155.577125:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789480155.577181:0:14344:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789480155.577188:0:14344:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789480155.577193:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb972366037fe516 00010000:00080000:3.0:1789480155.577223:0:14344:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22a0282800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00000100:00100000:2.0:1789480155.577512:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551982848:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789480155.577561:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405551982848 offset 0 length 520: 4 00010000:00010000:3.0:1789480155.578099:0:14344:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789480155.578607:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789480155.578943:0:14344:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789480155.580976:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480155.581068:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789480155.581164:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789480155.582041:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789480155.582045:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789480155.583111:0:14344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789480155.583124:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789480155.583157:0:14344:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789480155.583178:0:14344:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fe51d 00000100:00080000:3.0:1789480155.583189:0:14344:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480155.583200:0:14344:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1789480155.583234:0:14344:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bd683480 x1876405551982976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480155.583421:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551982976:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789480155.583498:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405551982976 offset 0 length 520: 4 00000100:00080000:3.0:1789480155.584016:0:14344:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789480155.584093:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.584099:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.584101:0:14344:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789480155.584104:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480155.584108:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.584109:0:14344:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789480155.584112:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789480155.584114:0:14344:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789480155.584117:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.584119:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.584120:0:14344:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789480155.584122:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480155.584124:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.584125:0:14344:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789480155.584137:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789480155.584171:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14344:1876405551983104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480155.584224:0:14344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.584256:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0347480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.584476:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983104 00000100:00100000:0.0:1789480155.584492:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983104 00000100:00100000:0.0:1789480155.584544:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480155.584554:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14344:x1876405551983104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480155.585023:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14344:x1876405551983104:12345-0@lo:502:llog_process_th.0 Request processed in 469us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.585031:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789480155.585555:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14344:1876405551983104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480155.585586:0:14344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.585593:0:14344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.585595:0:14344:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789480155.585601:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789480155.586016:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789480155.586040:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789480155.586095:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.586106:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5200/0xbb972366037fe4a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe4ad expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480155.586114:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2187178000 from 1 10000000:01000000:2.0:1789480155.586117:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789480155.586152:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.586161:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.586171:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480155.586188:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480155.586232:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.586331:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d51240 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.586533:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983232 00000100:00100000:0.0:1789480155.586540:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983232 00000100:00100000:0.0:1789480155.586581:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789480155.586589:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+9:14308:x1876405551983232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480155.586600:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480155.586612:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe524 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.586642:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe524 expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.586652:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe524 expref: 10 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.586666:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480155.586756:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+10:14308:x1876405551983232:12345-0@lo:101:mount.lustre.0 Request processed in 167us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.586762:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480155.587164:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480155.587181:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.587190:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.588190:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983360:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789480155.588257:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.588466:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0347480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.588692:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983360 00000100:00100000:2.0:1789480155.588809:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983360 00000100:00100000:2.0:1789480155.588891:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789480155.588900:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+10:14308:x1876405551983360:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789480155.588916:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789480155.588921:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789480155.588993:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+10:14308:x1876405551983360:12345-0@lo:256:mount.lustre.0 Request processed in 94us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.589000:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480155.589059:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983360:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789480155.589837:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789480155.589958:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.589970:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480155.589991:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2187178000 from 1 10000000:01000000:3.0:1789480155.589994:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480155.590022:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.590030:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.590040:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.590055:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480155.590091:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.590118:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0347480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.590331:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983488 00000100:00100000:0.0:1789480155.590337:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983488 00000100:00100000:0.0:1789480155.590371:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480155.590378:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+10:14308:x1876405551983488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480155.590388:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480155.590400:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe532 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.590420:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe532 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.590429:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe532 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.590437:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480155.590474:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551983488:12345-0@lo:101:mount.lustre.0 Request processed in 93us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.590479:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480155.590895:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480155.590908:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.590916:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.590964:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480155.590987:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.591006:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a0347480 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.591055:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983616 00000100:00100000:0.0:1789480155.591059:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983616 00000100:00100000:0.0:1789480155.591091:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789480155.591098:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551983616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480155.591822:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551983616:12345-0@lo:501:mount.lustre.0 Request processed in 724us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.591836:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480155.592089:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480155.592206:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480155.592262:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.592463:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d51d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480155.592568:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983744 00000100:00100000:3.0:1789480155.592579:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983744 00000100:00100000:3.0:1789480155.592845:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480155.592855:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551983744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480155.593027:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551983744:12345-0@lo:503:mount.lustre.0 Request processed in 174us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480155.593034:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480155.593120:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551983744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480155.593685:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14353:1876405551983872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480155.593915:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.594141:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d51180 going to sleep for 11 seconds 00000100:00100000:0.0:1789480155.594200:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551983872 00000100:00100000:0.0:1789480155.594206:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551983872 00000100:00100000:0.0:1789480155.594237:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480155.594257:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14353:x1876405551983872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480155.594521:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14353:x1876405551983872:12345-0@lo:502:llog_process_th.0 Request processed in 265us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480155.594527:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789480155.594947:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14353:1876405551983872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480155.594976:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480155.594986:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480155.594988:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789480155.594996:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2187178000 00000020:00000080:2.0:1789480155.594998:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789480155.595005:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480155.595007:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480155.595008:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789480155.595011:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480155.595013:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480155.595020:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789480155.595025:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2187178000 00000020:00000080:2.0:1789480155.595027:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789480155.595086:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480155.595090:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480155.595091:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789480155.595094:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480155.595096:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480155.595098:0:14353:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789480155.595101:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2187178000 00000020:00000080:2.0:1789480155.595103:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789480155.595145:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14353:1876405551984000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480155.595182:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.595198:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2290d51180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480155.597426:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984000 00000100:00100000:3.0:1789480155.597440:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984000 00000100:00100000:2.0:1789480155.597583:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480155.597593:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14353:x1876405551984000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480155.598001:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14353:x1876405551984000:12345-0@lo:502:llog_process_th.0 Request processed in 409us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.598009:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789480155.598125:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14353:1876405551984000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480155.598165:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480155.598173:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480155.598176:0:14353:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789480155.598182:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789480155.599471:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789480155.599505:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480155.599525:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.599538:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480155.599585:0:14308:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789480155.599589:0:14308:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2187178000 10000000:01000000:2.0:1789480155.599592:0:14308:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2187178000 10000000:01000000:2.0:1789480155.599603:0:14308:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480155.599608:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2187178000 from 1 10000000:01000000:2.0:1789480155.599612:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789480155.599656:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.599665:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.599674:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480155.599694:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480155.599907:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.599943:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.599970:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984128 00000100:00100000:2.0:1789480155.599975:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984128 00000100:00100000:2.0:1789480155.600003:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789480155.600010:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551984128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480155.600020:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480155.600031:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffe800/0xbb972366037fe547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe540 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.600051:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe800/0xbb972366037fe547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe540 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.600060:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffe800/0xbb972366037fe547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe540 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.600068:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe800, rc 0) 00000100:00100000:2.0:1789480155.600105:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984128:12345-0@lo:101:mount.lustre.0 Request processed in 95us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.600111:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789480155.600147:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480155.600160:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480155.600169:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480155.600209:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480155.600228:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.600239:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.600264:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984256 00000100:00100000:2.0:1789480155.600267:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984256 00000100:00100000:2.0:1789480155.600303:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480155.600375:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480155.600803:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984256:12345-0@lo:501:mount.lustre.0 Request processed in 492us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.600810:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480155.600845:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480155.600874:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480155.600910:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480155.600926:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.600939:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984384 00000100:00100000:2.0:1789480155.600943:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984384 00000100:00100000:2.0:1789480155.600966:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789480155.600973:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480155.601108:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984384:12345-0@lo:503:mount.lustre.0 Request processed in 136us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.601115:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789480155.601152:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480155.607691:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14355:1876405551984512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480155.609008:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480155.609058:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480155.610454:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984512 00000100:00100000:2.0:1789480155.610472:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984512 00000100:00100000:2.0:1789480155.610553:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789480155.610564:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14355:x1876405551984512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480155.611158:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14355:x1876405551984512:12345-0@lo:502:llog_process_th.0 Request processed in 595us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480155.611167:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789480155.611307:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14355:1876405551984512:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789480155.611385:0:14355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789480155.611401:0:14355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d22bd6b0000) 00000020:00000080:1.0:1789480155.611423:0:14355:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789480155.611529:0:14355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2187178000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789480155.611534:0:14355:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2187178000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789480155.611537:0:14355:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2187178000 4 00010000:00080000:1.0:1789480155.611575:0:14355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2286ffa000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1789480155.616114:0:14355:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789480155.617652:0:14355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789480155.618411:0:14355:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789480155.618432:0:14355:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb972366037fe555 00000100:00080000:1.0:1789480155.618444:0:14355:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480155.618456:0:14355:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2286ffa000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480155.619578:0:14355:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab45c00 x1876405551984640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480155.619613:0:14355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789480155.621973:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551984640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480155.622047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480155.622137:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984640 00000100:00100000:1.0:1789480155.622145:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984640 00000100:00100000:1.0:1789480155.622182:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480155.622189:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405551984640:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480155.622258:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876405551984640:12345-0@lo:38:llog_process_th.0 Request processed in 67us (210us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789480155.622265:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480155.622561:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789480155.622570:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2286ffa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480155.622574:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789480155.622578:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551984640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480155.640104:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14355:1876405551984768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480155.640195:0:14355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480155.640234:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2283496c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480155.640270:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984768 00000100:00100000:1.0:1789480155.640278:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984768 00000100:00100000:1.0:1789480155.641971:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789480155.641986:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14355:x1876405551984768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480155.642297:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14355:x1876405551984768:12345-0@lo:502:llog_process_th.0 Request processed in 299us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480155.642306:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789480155.642381:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14355:1876405551984768:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789480155.642416:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789480155.643576:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789480155.643604:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789480155.643626:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.643639:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bafffa00/0xbb972366037fe540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe547 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789480155.643693:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789480155.644400:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480155.644403:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480155.644404:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480155.644405:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480155.644408:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480155.644409:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480155.644411:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480155.644413:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480155.644414:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480155.644418:0:14308:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789480155.644427:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480155.644429:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480155.644430:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480155.644431:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480155.644432:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480155.644433:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480155.644433:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480155.644434:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480155.644435:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480155.644436:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480155.644462:0:14308:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789480155.644481:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480155.644907:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480155.644996:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480155.651917:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551984896 00000100:00100000:3.0:1789480155.651930:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551984896 00000100:00100000:3.0:1789480155.652018:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789480155.652028:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14308:x1876405551984896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789480155.652060:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789480155.652074:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789480155.714068:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789480155.714088:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789480155.714142:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789480155.714147:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789480155.714169:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.714188:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe524 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.714197:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.714234:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480155.714260:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480155.714274:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551985024:0@lo:104: 00000100:00100000:0.0:1789480155.714354:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480155.714415:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480155.714511:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985024 00000100:00100000:3.0:1789480155.714520:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985024 00000100:00100000:3.0:1789480155.714569:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480155.714580:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551985024:12345-0@lo:104: 00010000:00010000:3.0:1789480155.714594:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.714650:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789480155.714661:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551985024:12345-0@lo:104: Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480155.714668:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480155.714726:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551985024:0@lo:104: 00010000:00010000:3.0:1789480155.714744:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.714760:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480155.714765:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.714772:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffe00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480155.714775:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.714783:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480155.714790:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480155.714795:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480155.715009:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715017:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480155.715039:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715046:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bafffe00/0xbb972366037fe524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe52b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715068:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.715069:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480155.715071:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480155.715096:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551985152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480155.715128:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480155.715190:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985152 00000100:00100000:3.0:1789480155.715195:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985152 00010000:00010000:3.0:1789480155.715211:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 13 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.715229:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480155.715234:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+13:3298:x1876405551985152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480155.715256:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480155.715260:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 13 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715272:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 13 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715315:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6000/0xbb972366037fe52b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe524 expref: 13 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715329:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715337:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789480155.715349:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001203331s 00010000:00010000:3.0:1789480155.715359:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715365:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715371:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715377:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715381:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480155.715385:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715391:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715404:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715413:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480155.715444:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3298:x1876405551985152:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480155.715450:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789480155.715474:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715481:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480155.715497:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6c00/0xbb972366037fe55c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480155.715524:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551985152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480155.725641:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14308:x1876405551984896:12345-0@lo:253:mount.lustre.0 Request processed in 73607us (80727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480155.725654:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789480155.725888:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14308:1876405551984896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480155.725902:0:14308:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789480155.725906:0:14308:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480155.725907:0:14308:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480155.725909:0:14308:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480155.725910:0:14308:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480155.725912:0:14308:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480155.725913:0:14308:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480155.725914:0:14308:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480155.725916:0:14308:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480155.725917:0:14308:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480155.725918:0:14308:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789480155.725932:0:14308:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789480155.731690:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480155.732081:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480155.732422:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480155.732574:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480155.733046:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480155.733206:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480155.734415:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480155.734575:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480155.735051:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789480155.735507:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789480155.735987:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789480155.736138:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789480155.766676:0:14308:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789480155.770154:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789480155.770456:0:14366:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789480155.770461:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789480155.770572:0:14367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789480155.770671:0:14367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480155.774319:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789480155.774390:0:14367:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789480155.774394:0:14367:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789480155.775443:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789480155.775570:0:14308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789480155.776265:0:14308:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789480155.776539:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789480155.776863:0:14308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480155.778075:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789480155.778905:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789480155.778948:0:14308:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789480155.781666:0:14308:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789480155.787536:0:14308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789480155.818213:0:14308:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789480155.818264:0:14308:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa28701ce3988 00100000:10000000:2.0:1789480155.818272:0:14308:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789480155.819226:0:14308:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789480155.819258:0:14308:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789480155.819273:0:14308:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789480155.819332:0:14308:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789480156.191969:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480156.700083:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789480156.892387:0:14324:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789480156.892397:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2187178000 from 6 10000000:01000000:1.0:1789480156.892402:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789480156.892460:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480156.892479:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480156.892491:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480156.892523:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551985280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480156.892594:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480156.892661:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480156.893002:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985280 00000100:00100000:3.0:1789480156.893012:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985280 00000100:00100000:3.0:1789480156.893070:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480156.893078:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14324:x1876405551985280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480156.893091:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480156.893105:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe563 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480156.893128:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe563 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480156.893139:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe563 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480156.893159:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4a00, rc 0) 00000100:00100000:3.0:1789480156.893211:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551985280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480156.893228:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789480156.893326:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551985280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480156.893341:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480156.893350:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480156.893405:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551985408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480156.893434:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480156.893460:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480156.893525:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985408 00000100:00100000:3.0:1789480156.893529:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985408 00000100:00100000:3.0:1789480156.893552:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480156.893558:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551985408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789480156.893570:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789480156.893585:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789480156.893588:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789480156.893672:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551985408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480156.893812:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789480156.893890:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551985408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480156.893940:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480156.893947:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480156.893960:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480157.210691:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480157.725273:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789480158.234571:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480159.265850:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480160.289520:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480160.978502:0:14609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789480161.120945:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480161.120952:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480161.120955:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480161.120957:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480161.120960:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789480161.120963:0:12631:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480161.120966:0:12631:0:(import.c:65:import_set_state_nolock()) ffff8d2286ffa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480161.120983:0:12631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2286ffa000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480161.120992:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480161.121008:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551985536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480161.121073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480161.121144:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985536 00000100:00100000:1.0:1789480161.121151:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985536 00000100:00100000:1.0:1789480161.121206:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480161.121215:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3298:x1876405551985536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480161.121275:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3298:x1876405551985536:12345-0@lo:400:kworker.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480161.121304:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480161.121354:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551985536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480161.121390:0:12631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab46300 x1876405551985664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480161.121414:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551985664:0@lo:38:kworker.0 00000100:00100000:1.0:1789480161.121442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480161.121684:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985664 00000100:00100000:3.0:1789480161.121689:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985664 00000100:00100000:3.0:1789480161.121728:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480161.121734:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876405551985664:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789480161.121755:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:3.0:1789480161.121789:0:14328:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb972366037fe571 00000004:00100000:3.0:1789480161.121803:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789480161.121930:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8d2283304000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480161.121987:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876405551985664:12345-0@lo:38:kworker.0 Request processed in 252us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480161.121994:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789480161.122073:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22bab46300 x1876405551985664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789480161.122086:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789480161.122093:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789480161.122098:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789480161.122100:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2286ffa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789480161.122106:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876405551985664:0@lo:38:kworker.0 00010000:00010000:2.0:1789480161.309730:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480162.332474:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480163.355647:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480164.382015:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789480164.417721:0:14760:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe262bc7a0 20000000:00000080:2.0:1789480164.417738:0:14760:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d22923fa000 uarg=0000000000000000 20000000:01000000:2.0:1789480164.417771:0:14760:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789480164.417779:0:14760:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789480164.417784:0:14760:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789480164.418596:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789480164.418757:0:14760:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789480164.424168:0:14760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789480164.424198:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.424216:0:14760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe532 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.424225:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.424266:0:14760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 11 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.424521:0:14760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 11 pid: 14320 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480164.424537:0:14760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14760:1876405551985792:0@lo:104: 00000100:00100000:3.0:1789480164.424598:0:14760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480164.424648:0:14760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bab980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480164.424723:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985792 00000100:00100000:0.0:1789480164.424730:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985792 00000100:00100000:0.0:1789480164.424776:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480164.424784:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14760:x1876405551985792:12345-0@lo:104: 00010000:00010000:0.0:1789480164.424796:0:14310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480164.424851:0:14310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480164.424857:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14760:x1876405551985792:12345-0@lo:104: Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480164.424864:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789480164.424912:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480164.424918:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.424926:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:2.0:1789480164.424930:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.424955:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480164.424962:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480164.424968:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789480164.425007:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.425013:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480164.425030:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.425037:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4200/0xbb972366037fe532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe539 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.425053:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480164.425055:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480164.425056:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480164.425090:0:14760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14760:1876405551985792:0@lo:104: 00010000:00010000:2.0:1789480164.425108:0:14760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480164.425390:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405551985920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480164.425421:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480164.425506:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551985920 00000100:00100000:3.0:1789480164.425510:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551985920 00010000:00010000:3.0:1789480164.425530:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 12 pid: 14320 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480164.425557:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480164.425564:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3300:x1876405551985920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480164.425574:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480164.425579:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 12 pid: 14320 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425597:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 12 pid: 14320 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425609:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe539 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe532 expref: 12 pid: 14320 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425622:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425630:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425643:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425650:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425657:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425664:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425670:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480164.425674:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425681:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425703:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480164.425712:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480164.425745:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:3300:x1876405551985920:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480164.425752:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480164.425778:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405551985920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480164.425865:0:14760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.425873:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480164.425890:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe578 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480165.214129:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480155/real 1789480155] req@ffff8d22bd683480 x1876405551982976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480165.214163:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22bd683480 x1876405551982976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480165.217042:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480155/real 1789480155] req@ffff8d22bd682680 x1876405551982848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480165.217088:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d22bd682680 x1876405551982848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789480165.217110:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480165.218069:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789480165.218075:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551982976:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789480165.218083:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480165.220171:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480165.220178:0:12631:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789480165.220182:0:12631:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480165.220191:0:12631:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1789480165.220204:0:12631:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789480165.220219:0:12631:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2186b38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480165.220244:0:12631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187731500 x1876405551986176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480165.220256:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480165.220260:0:12631:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789480165.220261:0:12631:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480165.220265:0:12631:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1789480165.220267:0:12631:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789480165.220271:0:12631:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1789480165.220298:0:12631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187733800 x1876405551986304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480165.220343:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480165.220357:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405551986048:0@lo:400:kworker.0 00000100:00100000:0.0:1789480165.220416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480165.220469:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480165.220476:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551986432:0@lo:400:kworker.0 00000100:00100000:0.0:1789480165.220507:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480165.220535:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986048 00000100:00100000:0.0:1789480165.220542:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986048 00000100:00100000:0.0:1789480165.220589:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480165.220598:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:3300:x1876405551986048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480165.220659:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:3300:x1876405551986048:12345-0@lo:400:kworker.0 Request processed in 62us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480165.220666:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480165.220705:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986432 00000100:00100000:0.0:1789480165.220715:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986432 00000100:00100000:0.0:1789480165.220738:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480165.220743:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551986432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480165.220787:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551986432:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480165.220794:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789480165.220834:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2187731c00 x1876405551986432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480165.220847:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551986432:0@lo:400:kworker.0 00000100:00100000:0.0:1789480165.220874:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405551986048:0@lo:400:kworker.0 00000100:00080000:3.0:1789480165.221205:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789480165.221212:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551982848:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789480165.221739:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551986176:0@lo:8:kworker.0 00000400:00000100:3.0:1789480165.221772:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405551986176 offset 0 length 520: 4 00000100:00100000:3.0:1789480165.221789:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551986304:0@lo:8:kworker.0 00000400:00000100:3.0:1789480165.221806:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405551986304 offset 0 length 520: 4 00010000:00010000:3.0:1789480165.404543:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789480166.234405:0:14324:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480166.234412:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2187178000 from 10 10000000:01000000:0.0:1789480166.234417:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480166.234466:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480166.234478:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480166.234490:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480166.234516:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480166.234582:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480166.234644:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480166.234729:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986560 00000100:00100000:1.0:1789480166.234737:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986560 00000100:00100000:1.0:1789480166.234791:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789480166.234799:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+11:14324:x1876405551986560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480166.234811:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480166.234824:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe57f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480166.234844:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe57f expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480166.234855:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe57f expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480166.234863:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c800, rc 0) 00000100:00100000:1.0:1789480166.234913:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551986560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480166.234920:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480166.235394:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480166.235409:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480166.235419:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480166.235471:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480166.235496:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480166.235536:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480166.235591:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986688 00000100:00100000:0.0:1789480166.235595:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986688 00000100:00100000:0.0:1789480166.235627:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789480166.235642:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551986688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480166.235897:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551986688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480166.235904:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789480166.238092:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480166.238154:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480166.238220:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480166.238264:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480166.239882:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986816 00000100:00100000:0.0:1789480166.239894:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986816 00000100:00100000:0.0:1789480166.239957:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789480166.239966:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551986816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480166.240197:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:14324:x1876405551986816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480166.240205:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480166.240370:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551986816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480166.241682:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789480166.247387:0:14324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789480166.247420:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480166.247432:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480166.247446:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480166.426566:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480167.453725:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480167.966626:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789480168.475685:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480169.498957:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480170.330497:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480170.330504:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480170.330508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480170.330511:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480170.330620:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551986944:0@lo:400:kworker.0 00000100:00100000:2.0:1789480170.330696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480170.330848:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551986944 00000100:00100000:0.0:1789480170.330856:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551986944 00000100:00100000:0.0:1789480170.330910:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480170.330919:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3299:x1876405551986944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480170.330997:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:3299:x1876405551986944:12345-0@lo:400:kworker.0 Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480170.331004:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789480170.331133:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551986944:0@lo:400:kworker.0 00000100:00100000:3.0:1789480170.331271:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551987072:0@lo:400:kworker.0 00000100:00100000:3.0:1789480170.331323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480170.331402:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987072 00000100:00100000:1.0:1789480170.331407:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987072 00000100:00100000:1.0:1789480170.331431:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480170.331437:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551987072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480170.331481:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551987072:12345-0@lo:400:kworker.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480170.331487:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789480170.331585:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2187732d80 x1876405551987072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480170.331596:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551987072:0@lo:400:kworker.0 00010000:00010000:2.0:1789480170.522439:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789480171.420141:0:15009:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789480171.420145:0:15009:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789480171.420247:0:15009:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2286ffc000 00000020:01000004:1.0:1789480171.420263:0:15009:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789480171.420274:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789480171.420311:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d22bd6b3380) 00000020:00000080:1.0:1789480171.420325:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789480171.475921:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789480171.476251:0:15009:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789480171.480402:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789480171.480659:0:15009:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789480171.480952:0:15009:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789480171.481539:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789480171.481635:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789480171.481777:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789480171.489183:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 74: rc = 0 00100000:10000000:3.0:1789480171.489594:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 74: rc = 0 00100000:10000000:3.0:1789480171.490949:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 74: rc = 0 00100000:10000000:3.0:1789480171.491480:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 74: rc = 0 00100000:10000000:3.0:1789480171.492163:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 74: rc = 0 00100000:10000000:3.0:1789480171.492519:0:15009:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 74: rc = 0 00000020:00000080:3.0:1789480171.494123:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789480171.494136:0:15009:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789480171.494148:0:15009:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fe594 00000020:01000004:3.0:1789480171.494157:0:15009:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789480171.494178:0:15009:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789480171.494181:0:15009:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789480171.494187:0:15009:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789480171.494191:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789480171.494202:0:15009:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d22bcb019c0) 00000020:00000080:3.0:1789480171.494223:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789480171.495578:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480171.500759:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789480171.500772:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789480171.506013:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789480171.506028:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789480171.506623:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789480171.506634:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789480171.510801:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480171.514173:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789480171.514188:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789480171.527576:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789480171.527598:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1789480171.562163:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480171.574653:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789480171.574904:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789480171.574911:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789480171.579915:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789480171.580017:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789480171.580976:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789480171.580984:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789480171.590166:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480171.590622:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789480171.590629:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789480171.595102:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789480171.595119:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789480171.647621:0:15009:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480171.647963:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789480171.647971:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789480171.650866:0:15009:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789480171.650885:0:15009:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789480171.652397:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789480171.652426:0:15009:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789480171.652439:0:15009:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789480171.679520:0:15009:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789480171.679561:0:15009:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789480171.679566:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789480171.679568:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789480171.679570:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480171.679571:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480171.679572:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480171.679574:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480171.679576:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480171.679577:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480171.679579:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480171.679583:0:15009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789480171.679585:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789480171.679587:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789480171.679588:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480171.679589:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480171.679590:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480171.679591:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480171.679592:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480171.679593:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480171.679594:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789480171.679624:0:15009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789480171.679645:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789480171.679736:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.679788:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.680014:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987200 00000100:00100000:1.0:1789480171.680022:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987200 00000100:00100000:1.0:1789480171.680115:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480171.680125:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:15009:x1876405551987200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789480171.680164:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789480171.680168:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789480171.680172:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789480171.686585:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:15009:x1876405551987200:12345-0@lo:253:mount.lustre.0 Request processed in 6451us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.686599:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789480171.689756:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789480171.689800:0:15009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789480171.689803:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789480171.689805:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789480171.689807:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480171.689808:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480171.689810:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480171.689811:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480171.689812:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480171.689814:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480171.689816:0:15009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789480171.689840:0:15009:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2286ffc000 from lustre-OST0000 10000000:01000000:3.0:1789480171.689872:0:15009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789480171.689875:0:15009:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789480171.689882:0:15009:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d22a4acb380 local copy 00010000:00010000:3.0:1789480171.689895:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480171.690168:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480171.690229:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.690279:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.690566:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987328 00000100:00100000:1.0:1789480171.690573:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987328 00000100:00100000:1.0:1789480171.690626:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480171.690635:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:15009:x1876405551987328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480171.690834:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:15009:x1876405551987328:12345-0@lo:501:mount.lustre.0 Request processed in 200us (604us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480171.690844:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789480171.691121:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987328:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789480171.691139:0:15009:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789480171.691314:0:15009:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789480171.691323:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.691334:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480171.691366:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2286ffc000 10000000:01000000:3.0:1789480171.691377:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789480171.691382:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d22a4acb380 10000000:01000000:3.0:1789480171.691385:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789480171.691389:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d22a4acb380 from 1 10000000:01000000:3.0:1789480171.691392:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789480171.691421:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.691430:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.691440:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480171.691455:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480171.691486:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.691507:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480171.691567:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987456 00000100:00100000:0.0:1789480171.691573:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987456 00000100:00100000:0.0:1789480171.691609:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480171.691617:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+12:15009:x1876405551987456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480171.691627:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480171.691640:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7800/0xbb972366037fe5a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe5a2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.691662:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7800/0xbb972366037fe5a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe5a2 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.691687:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7800/0xbb972366037fe5a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe5a2 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.691697:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7800, rc 0) 00000100:00100000:0.0:1789480171.691734:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+13:15009:x1876405551987456:12345-0@lo:101:mount.lustre.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.691741:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789480171.691875:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480171.691887:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.691896:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480171.691910:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789480171.695217:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.695237:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5400/0xbb972366037fe5a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5a9 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480171.695270:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789480171.695277:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480171.695298:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789480171.695302:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789480171.695339:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.695348:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.695360:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480171.695384:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480171.695451:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.695484:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480171.698202:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987584 00000100:00100000:0.0:1789480171.698218:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987584 00000100:00100000:0.0:1789480171.698341:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789480171.698352:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+13:15009:x1876405551987584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480171.698370:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480171.698388:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe5b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe5b0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.698430:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe5b0 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.698440:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7e00/0xbb972366037fe5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe5b0 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.698448:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7e00, rc 0) 00000100:00100000:0.0:1789480171.698520:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987584:12345-0@lo:101:mount.lustre.0 Request processed in 170us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.698526:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789480171.698659:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480171.698692:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.698703:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480171.700175:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789480171.701243:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480171.701533:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789480171.701582:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789480171.701611:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789480171.701651:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789480171.703331:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789480171.703408:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789480171.703512:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789480171.703520:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789480171.703632:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480171.704955:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.705018:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.707135:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987712 00000100:00100000:1.0:1789480171.707152:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987712 00000100:00100000:1.0:1789480171.707214:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789480171.707224:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480171.707751:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987712:12345-0@lo:501:mount.lustre.0 Request processed in 527us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.707759:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789480171.707963:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480171.708026:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480171.708075:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.708120:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480171.708401:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987840 00000100:00100000:0.0:1789480171.708407:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987840 00000100:00100000:0.0:1789480171.708450:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789480171.708458:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480171.708784:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987840:12345-0@lo:503:mount.lustre.0 Request processed in 326us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.708798:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789480171.709226:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789480171.710330:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789480171.710414:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480171.710476:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.710525:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.710684:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551987968 00000100:00100000:2.0:1789480171.710691:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551987968 00000100:00100000:2.0:1789480171.710738:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789480171.710746:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480171.710973:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551987968:12345-0@lo:502:mount.lustre.0 Request processed in 227us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.710981:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789480171.712275:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551987968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480171.713433:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789480171.713505:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789480171.713544:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789480171.713628:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789480171.715108:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789480171.715206:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789480171.715278:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789480171.716498:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789480171.716535:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789480171.716597:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789480171.716632:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789480171.719995:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789480171.720065:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480171.720153:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480171.720204:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.721745:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988096 00000100:00100000:2.0:1789480171.721758:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988096 00000100:00100000:2.0:1789480171.721829:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789480171.721841:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551988096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480171.722125:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551988096:12345-0@lo:502:mount.lustre.0 Request processed in 286us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.722134:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789480171.722647:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480171.722762:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789480171.722776:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789480171.724025:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480171.724035:0:15023:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789480171.724043:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480171.724045:0:15023:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789480171.724051:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480171.724068:0:15023:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d22b99c3380) 00000020:00000080:0.0:1789480171.724092:0:15023:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789480171.724098:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789480171.724177:0:15023:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2286ffc000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789480171.724185:0:15023:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789480171.724191:0:15023:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb972366037fe5c5 00010000:00010000:1.0:1789480171.735712:0:15023:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789480171.736133:0:15023:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789480171.755075:0:15023:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789480171.769385:0:15023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789480171.769401:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.769408:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769416:0:15023:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789480171.769422:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789480171.769425:0:15023:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789480171.769427:0:15023:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480171.769429:0:15023:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480171.769430:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789480171.769433:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769435:0:15023:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789480171.769438:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480171.769441:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769442:0:15023:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789480171.769445:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789480171.769447:0:15023:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789480171.769449:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.769451:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769452:0:15023:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789480171.769454:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480171.769456:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769458:0:15023:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789480171.769461:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789480171.769540:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.769544:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.769545:0:15023:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789480171.769548:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789480171.769775:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789480171.769802:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789480171.769828:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.769842:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4e00/0xbb972366037fe5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5b7 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480171.769850:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2286ffc000 from 1 10000000:01000000:1.0:1789480171.769853:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480171.769889:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.769898:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.769910:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480171.769946:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480171.770041:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.770084:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480171.770193:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988224 00000100:00100000:3.0:1789480171.770202:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988224 00000100:00100000:3.0:1789480171.770256:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789480171.770265:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+14:15009:x1876405551988224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480171.770279:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480171.770312:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe5cc expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.770336:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe5cc expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.770354:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe5cc expref: 15 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.770363:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4400, rc 0) 00000100:00100000:3.0:1789480171.770413:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988224:12345-0@lo:101:mount.lustre.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480171.770420:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480171.770454:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480171.770470:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.770481:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480171.771137:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789480171.771652:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480171.774352:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789480171.774413:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789480171.774479:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789480171.774489:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789480171.774593:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480171.774660:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.776692:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.778194:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988352 00000100:00100000:2.0:1789480171.778206:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988352 00000100:00100000:2.0:1789480171.778255:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480171.778266:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480171.778603:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988352:12345-0@lo:501:mount.lustre.0 Request processed in 338us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.778611:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789480171.779028:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480171.779079:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480171.779126:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.779155:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.779391:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988480 00000100:00100000:2.0:1789480171.779397:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988480 00000100:00100000:2.0:1789480171.779438:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789480171.779446:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480171.779609:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988480:12345-0@lo:503:mount.lustre.0 Request processed in 162us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.779621:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480171.779718:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789480171.780233:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789480171.780332:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480171.780373:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.780403:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22ac35a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.780924:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988608 00000100:00100000:1.0:1789480171.780941:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988608 00000100:00100000:1.0:1789480171.780982:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480171.780998:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480171.781170:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988608:12345-0@lo:502:mount.lustre.0 Request processed in 173us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.781187:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480171.782858:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480171.783236:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789480171.783325:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789480171.783381:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789480171.783432:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789480171.783468:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789480171.783512:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789480171.783551:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789480171.783585:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789480171.783627:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480171.784612:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.784665:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480171.784979:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988736 00000100:00100000:0.0:1789480171.784998:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988736 00000100:00100000:0.0:1789480171.785051:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789480171.785060:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480171.785321:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988736:12345-0@lo:502:mount.lustre.0 Request processed in 261us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.785329:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789480171.786118:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480171.786276:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789480171.786318:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789480171.787433:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480171.787444:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.787446:0:15027:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789480171.787455:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2286ffc000 00000020:00000080:3.0:1789480171.787458:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480171.787465:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.787468:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.787469:0:15027:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789480171.787472:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480171.787474:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.787476:0:15027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789480171.787479:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2286ffc000 00000020:00000080:3.0:1789480171.787482:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480171.787865:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.787869:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.787871:0:15027:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789480171.787874:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480171.787877:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.787879:0:15027:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480171.787883:0:15027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2286ffc000 00000020:00000080:3.0:1789480171.787885:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480171.789048:0:15027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480171.789058:0:15027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480171.789065:0:15027:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789480171.789070:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789480171.791954:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789480171.792009:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480171.792027:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.792053:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480171.792107:0:15009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789480171.792110:0:15009:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2286ffc000 10000000:01000000:0.0:1789480171.792114:0:15009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2286ffc000 10000000:01000000:0.0:1789480171.792118:0:15009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789480171.792124:0:15009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2286ffc000 from 1 10000000:01000000:0.0:1789480171.792127:0:15009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789480171.792162:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.792171:0:15009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.792183:0:15009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480171.792210:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480171.792271:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.792328:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480171.792786:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988864 00000100:00100000:3.0:1789480171.792795:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988864 00000100:00100000:3.0:1789480171.793002:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789480171.793013:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551988864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480171.793027:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480171.793043:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4600/0xbb972366037fe5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe5da expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.793068:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4600/0xbb972366037fe5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe5da expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.793080:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4600/0xbb972366037fe5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe5da expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480171.793090:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4600, rc 0) 00000100:00100000:3.0:1789480171.793146:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551988864:12345-0@lo:101:mount.lustre.0 Request processed in 135us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480171.793154:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789480171.793344:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480171.793361:0:15009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.793372:0:15009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480171.793965:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789480171.794618:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480171.795883:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789480171.795945:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789480171.795994:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789480171.796043:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789480171.796084:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789480171.796135:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789480171.796187:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789480171.796239:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789480171.796317:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789480171.796355:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789480171.796388:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789480171.796432:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789480171.796465:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789480171.796512:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789480171.796564:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789480171.796602:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789480171.796639:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789480171.796684:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789480171.796725:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789480171.796767:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789480171.796831:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789480171.796871:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789480171.796903:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789480171.796968:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789480171.797011:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789480171.797044:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789480171.797104:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789480171.815071:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789480171.815193:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789480171.815204:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789480171.815349:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480171.815414:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.815453:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.815921:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551988992 00000100:00100000:2.0:1789480171.815938:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551988992 00000100:00100000:2.0:1789480171.816525:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789480171.816535:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551988992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480171.817211:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551988992:12345-0@lo:501:mount.lustre.0 Request processed in 676us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.817221:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789480171.817333:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551988992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480171.817386:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480171.817427:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.836195:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.840892:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989120 00000100:00100000:1.0:1789480171.840910:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989120 00000100:00100000:1.0:1789480171.840982:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789480171.841003:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480171.841264:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989120:12345-0@lo:503:mount.lustre.0 Request processed in 263us (23835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.841272:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789480171.843228:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989120:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789480171.843847:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789480171.843923:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480171.844004:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.844046:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480171.844371:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989248 00000100:00100000:1.0:1789480171.844378:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989248 00000100:00100000:1.0:1789480171.844410:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789480171.844419:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480171.844624:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989248:12345-0@lo:502:mount.lustre.0 Request processed in 205us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.844632:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789480171.844775:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789480171.845039:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789480171.845089:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789480171.845127:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789480171.845175:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789480171.845227:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789480171.845310:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789480171.845353:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789480171.845389:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789480171.845450:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789480171.845488:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789480171.845523:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789480171.845574:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789480171.845614:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789480171.845649:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789480171.848223:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789480171.848303:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789480171.848343:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789480171.848393:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789480171.848428:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789480171.848477:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789480171.848551:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789480171.848590:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789480171.848631:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789480171.849903:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789480171.849991:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789480171.850030:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789480171.850084:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789480171.850123:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789480171.850156:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789480171.850201:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789480171.850240:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789480171.850275:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789480171.850333:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789480171.850383:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789480171.850421:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789480171.850471:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789480171.850530:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789480171.850565:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789480171.850612:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789480171.850648:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789480171.850717:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480171.851918:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.851979:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a092af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.852157:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989376 00000100:00100000:2.0:1789480171.852166:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989376 00000100:00100000:2.0:1789480171.852212:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480171.852221:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480171.852518:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989376:12345-0@lo:502:mount.lustre.0 Request processed in 296us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480171.852526:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789480171.852628:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789480171.854259:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789480171.854303:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789480171.859116:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789480171.859141:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d22b99c0000) 00000020:00000080:0.0:1789480171.859166:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789480171.859262:0:15032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2286ffc000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789480171.859271:0:15032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2286ffc000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789480171.859274:0:15032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2286ffc000 3 00010000:00080000:0.0:1789480171.859334:0:15032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d22bb590000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1789480171.864390:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789480171.870327:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789480171.870370:0:15032:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789480171.870386:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb972366037fe5ef 00000100:00080000:1.0:1789480171.870397:0:15032:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480171.870411:0:15032:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d22bb590000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480171.870472:0:15032:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab44380 x1876405551989504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480171.870507:0:15032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789480171.872144:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480171.872152:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480171.872155:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480171.872158:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789480171.874051:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551989632:0@lo:400:kworker.0 00000100:00100000:0.0:1789480171.874126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.874187:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989632 00000100:00100000:0.0:1789480171.874195:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989632 00000100:00100000:0.0:1789480171.874243:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480171.874252:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551989632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480171.874321:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551989632:12345-0@lo:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.874328:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789480171.874389:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d218706b800 x1876405551989632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480171.874404:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551989632:0@lo:400:kworker.0 00000100:00100000:3.0:1789480171.880215:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551989504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480171.880330:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.881239:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989504 00000100:00100000:1.0:1789480171.881249:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989504 00000100:00100000:1.0:1789480171.881312:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480171.881320:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876405551989504:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789480171.881348:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1789480171.881387:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb972366037fe5f6 00000004:00100000:1.0:1789480171.881402:0:14327:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789480171.881438:0:14327:0:(import.c:65:import_set_state_nolock()) ffff8d229c50e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480171.881506:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876405551989504:12345-0@lo:38:llog_process_th.0 Request processed in 185us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.881514:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789480171.881682:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789480171.882892:0:15009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789480171.882919:0:15009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789480171.882951:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.882964:0:15009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6e00/0xbb972366037fe5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe5e1 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789480171.883900:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789480171.883903:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480171.883905:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480171.883906:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480171.883907:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480171.883908:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480171.883909:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480171.883911:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480171.883912:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480171.883917:0:15009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789480171.883919:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480171.883921:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480171.883921:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480171.883923:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480171.883934:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480171.883935:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480171.883936:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480171.883937:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480171.883938:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480171.883965:0:15009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789480171.883983:0:15009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480171.885249:0:15009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.885310:0:15009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480171.885417:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989760 00000100:00100000:2.0:1789480171.885425:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989760 00000100:00100000:2.0:1789480171.885481:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789480171.885491:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15009:x1876405551989760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480171.885535:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789480171.885554:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789480171.887369:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d22bab44380 x1876405551989504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480171.887383:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480171.887392:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789480171.887401:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789480171.887406:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789480171.887422:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22bb590000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789480171.887428:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876405551989504:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789480171.940373:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789480171.940392:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789480171.940460:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789480171.940466:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789480171.940488:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.940569:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe563 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.940580:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.941239:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.941280:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 16 pid: 14318 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480171.941321:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551989888:0@lo:104: 00000100:00100000:0.0:1789480171.941558:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480171.941652:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480171.950265:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551989888 00000100:00100000:0.0:1789480171.950299:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551989888 00000100:00100000:0.0:1789480171.950361:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480171.950372:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551989888:12345-0@lo:104: 00010000:00010000:0.0:1789480171.950391:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480171.950515:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480171.950522:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551989888:12345-0@lo:104: Request processed in 153us (8965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480171.950528:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480171.950598:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551989888:0@lo:104: 00010000:00010000:3.0:1789480171.950623:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.950892:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480171.950900:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.950939:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:1.0:1789480171.950943:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.950952:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480171.950959:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480171.950965:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789480171.951016:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951024:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480171.951053:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951061:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe56a expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951079:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480171.951080:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480171.951082:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480171.951094:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480171.951106:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551990016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480171.951149:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480171.951215:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990016 00000100:00100000:1.0:1789480171.951220:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990016 00010000:00010000:1.0:1789480171.951251:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 17 pid: 14318 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480171.951277:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480171.951320:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:3299:x1876405551990016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480171.951331:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480171.951336:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 17 pid: 14318 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951349:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 17 pid: 14318 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951362:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4a00/0xbb972366037fe56a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe563 expref: 17 pid: 14318 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951374:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951383:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789480171.951409:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010943832s 00010000:00010000:1.0:1789480171.951414:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951422:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951429:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951437:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951448:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480171.951452:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951460:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951474:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951482:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480171.951524:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3299:x1876405551990016:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480171.951531:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480171.951573:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551990016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480171.951589:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951597:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480171.951604:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe5fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480171.962648:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:15009:x1876405551989760:12345-0@lo:253:mount.lustre.0 Request processed in 77147us (77389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480171.962663:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789480171.963026:0:15009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15009:1876405551989760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480171.963042:0:15009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789480171.963045:0:15009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480171.963047:0:15009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789480171.963062:0:15009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480171.963064:0:15009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480171.963065:0:15009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480171.963066:0:15009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480171.963068:0:15009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480171.963070:0:15009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480171.963071:0:15009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789480171.963090:0:15009:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789480171.974114:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789480171.974330:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789480171.974490:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789480171.975071:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789480171.975225:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789480171.977272:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789480171.982253:0:15009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789480172.109314:0:15009:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789480172.109323:0:15009:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789480172.109358:0:15009:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789480172.109420:0:15009:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789480172.109435:0:15009:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789480172.109468:0:15009:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789480172.570622:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480173.606775:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480173.978821:0:14324:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789480173.978829:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2187178000 from 7 10000000:01000000:3.0:1789480173.978833:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789480173.978881:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480173.978905:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480173.978916:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480173.978941:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551990144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480173.979012:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480173.979980:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789480173.986072:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990144 00000100:00100000:2.0:1789480173.986089:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990144 00000100:00100000:2.0:1789480173.986155:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789480173.986165:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+15:14324:x1876405551990144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480173.986183:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480173.986204:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe604 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480173.986234:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe604 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480173.986246:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe604 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480173.986255:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22baffe400, rc 0) 00000100:00100000:2.0:1789480173.986357:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:14324:x1876405551990144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (7343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480173.986363:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789480173.986530:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551990144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480173.986557:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480173.986567:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480173.986628:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551990272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789480173.986666:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480173.986706:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2287d4d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789480173.987607:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990272 00000100:00100000:2.0:1789480173.987615:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990272 00000100:00100000:2.0:1789480173.987650:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789480173.987658:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:14324:x1876405551990272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789480173.987681:0:14321:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789480173.987693:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789480173.987696:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789480173.987784:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:14324:x1876405551990272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480173.987792:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789480173.989728:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551990272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480173.989814:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480173.989825:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480173.989843:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480174.620029:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480175.642513:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480176.667011:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480176.986659:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1789480176.986688:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480176.986694:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480176.986697:0:12631:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480176.986700:0:12631:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480176.986819:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551990528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480176.986939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480176.987015:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480176.987021:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551990656:0@lo:400:kworker.0 00000100:00100000:2.0:1789480176.987050:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480176.987098:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990528 00000100:00100000:2.0:1789480176.987124:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990528 00000100:00100000:2.0:1789480176.987188:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990656 00000100:00100000:2.0:1789480176.987191:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990656 00000100:00100000:2.0:1789480176.987234:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480176.987244:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551990528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480176.987341:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551990528:12345-0@lo:400:kworker.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480176.987349:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480176.987372:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480176.987378:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551990656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480176.987415:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551990656:12345-0@lo:400:kworker.0 Request processed in 38us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480176.987421:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789480176.989300:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789480176.989868:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d218706aa00 x1876405551990656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480176.989889:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551990656:0@lo:400:kworker.0 00010000:00080000:2.0:1789480176.989906:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2187068700 x1876405551990528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480176.989915:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551990528:0@lo:400:kworker.0 00000100:00100000:0.0:1789480176.990714:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551990400:0@lo:400:kworker.0 00000100:00100000:0.0:1789480176.990809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480176.990880:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990400 00000100:00100000:0.0:1789480176.990889:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990400 00000100:00100000:0.0:1789480176.990953:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789480176.990977:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3298:x1876405551990400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480176.991121:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3298:x1876405551990400:12345-0@lo:400:kworker.0 Request processed in 147us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480176.991130:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789480176.991203:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551990400:0@lo:400:kworker.0 00000040:00080000:0.0:1789480177.183006:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789480177.692847:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480178.716474:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480179.740063:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480179.891847:0:15375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789480180.065133:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480165/real 1789480165] req@ffff8d2187731500 x1876405551986176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480180.065170:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2187731500 x1876405551986176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480180.065182:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480165/real 1789480165] req@ffff8d2187733800 x1876405551986304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480180.065193:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2187733800 x1876405551986304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789480180.065213:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480180.065354:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789480180.065359:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551986176:0@lo:8:kworker.0 00000100:00080000:3.0:1789480180.065366:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480180.070162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480180.070169:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789480180.070174:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480180.070182:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1789480180.070188:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789480180.070198:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2186b38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480180.070207:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480180.070227:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551990784:0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.070387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480180.070450:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990784 00000100:00100000:1.0:1789480180.070458:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990784 00000100:00100000:1.0:1789480180.070500:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789480180.070508:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3299:x1876405551990784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789480180.070619:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789480180.070626:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551986304:0@lo:8:kworker.0 00000100:00100000:1.0:1789480180.070957:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3299:x1876405551990784:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.070966:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789480180.071013:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551990784:0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.071049:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab45f80 x1876405551990912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480180.071076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480180.071090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789480180.071092:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480180.071095:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1789480180.071099:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789480180.071104:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480180.071117:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab44380 x1876405551991040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480180.071168:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551991296:0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.071210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480180.071247:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991296 00000100:00100000:1.0:1789480180.071252:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991296 00000100:00100000:1.0:1789480180.071386:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480180.071394:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551991296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.071435:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405551991296:12345-0@lo:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.071441:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789480180.071456:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480180.071464:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551991168:0@lo:400:kworker.0 00010000:00080000:1.0:1789480180.071474:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22bab45c00 x1876405551991296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480180.071484:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405551991296:0@lo:400:kworker.0 00000100:00100000:0.0:1789480180.071491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.071659:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551990912:0@lo:8:kworker.0 00000100:00100000:3.0:1789480180.071694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.071723:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551991040:0@lo:8:kworker.0 00000100:00100000:3.0:1789480180.071742:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.079307:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991168 00000100:00100000:3.0:1789480180.079323:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991168 00000100:00100000:3.0:1789480180.079584:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480180.079596:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551991168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480180.080882:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876405551991168:12345-0@lo:400:kworker.0 Request processed in 1285us (9384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.080893:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480180.081246:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551990912 00000100:00100000:1.0:1789480180.081255:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551990912 00000100:00100000:1.0:1789480180.081306:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991040 00000100:00100000:1.0:1789480180.081310:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991040 00000100:00100000:1.0:1789480180.081324:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480180.081330:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551990912:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789480180.081383:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1789480180.081412:0:15010:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fe612 00002000:00100000:1.0:1789480180.081425:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d229c50c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789480180.081429:0:15010:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789480180.081432:0:15010:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789480180.081778:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789480180.081809:0:15010:0:(import.c:65:import_set_state_nolock()) ffff8d229c508800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789480180.082227:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22bab46300 x1876405551991168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480180.082242:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876405551991168:0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.082967:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405551990912:12345-0@lo:8:kworker.0 Request processed in 1634us (11270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.082976:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480180.082999:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480180.083004:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551991040:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789480180.083031:0:15010:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789480180.083065:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551991040:12345-0@lo:8:kworker.0 Request processed in 59us (11321us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789480180.083071:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789480180.095268:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22bab45f80 x1876405551990912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480180.095314:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789480180.095324:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789480180.095333:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789480180.095339:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789480180.095343:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2186b38800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789480180.095375:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789480180.095381:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551990912:0@lo:8:kworker.0 00000100:00080000:2.0:1789480180.095407:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480180.095411:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480180.095414:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551991040:0@lo:8:kworker.0 00000004:00080000:3.0:1789480180.095643:0:14350:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789480180.095666:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1876405551991552:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789480180.095727:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.095750:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22996bd780 going to sleep for 11 seconds 00000004:00080000:3.0:1789480180.095783:0:14349:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789480180.096081:0:14349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473092797863ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789480180.096101:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480180.096111:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551991424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480180.096141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.097537:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991424 00000100:00100000:0.0:1789480180.097548:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991424 00000100:00100000:0.0:1789480180.097613:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480180.097623:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551991424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480180.097658:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480180.097728:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876405551991424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.097744:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789480180.097805:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d22bd680a80 x1876405551991424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480180.097824:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551991424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789480180.097974:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480180.098536:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991552 00000100:00100000:2.0:1789480180.098542:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991552 00000100:00100000:2.0:1789480180.098579:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480180.098586:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14350:x1876405551991552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789480180.107470:0:15012:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789480180.107482:0:15012:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789480180.107486:0:15012:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1789480180.138506:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.138519:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.138535:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.138540:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.138546:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.138566:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.138577:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.138585:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.138611:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480180.141239:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.141251:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.141267:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.141271:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.141277:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.141314:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.141323:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.141330:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.143099:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789480180.144742:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.144755:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.144789:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.144801:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.144808:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.144832:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.144844:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.144853:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.144865:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789480180.146111:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.146120:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.146134:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.146137:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.146142:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.146152:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.146161:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.146175:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.146184:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789480180.149750:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.149777:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.149794:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.149799:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.149806:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.149820:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.149900:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.149908:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.149920:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1789480180.151019:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.151028:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.151049:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.151053:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.151057:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.151068:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.151076:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.151084:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.151093:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789480180.154860:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789480180.154875:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154888:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffe000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.154894:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154906:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154941:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154949:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c73555f/0xbb972366037fe619 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154972:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789480180.154976:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154982:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffec00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.154986:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.154992:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155001:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155008:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bba6849/0xbb972366037fe620 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155019:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789480180.155022:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155034:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.155038:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155045:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155056:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155062:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001daced03/0xbb972366037fe627 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155074:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789480180.155078:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155084:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffea00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.155087:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155093:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155102:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155115:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e184f81f/0xbb972366037fe62e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155127:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480180.155131:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155137:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.155140:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155147:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155156:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155162:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c9ef0d9/0xbb972366037fe635 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155172:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.155175:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155180:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22baffee00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.155189:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155196:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155206:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155225:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff8cbee/0xbb972366037fe63c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155239:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.155240:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.155245:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.155252:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.155583:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.155591:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155602:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.155606:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.155612:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155623:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155642:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155650:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155667:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.155678:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.155681:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155688:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.155690:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155697:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155708:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155713:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d53575/0xbb972366037fe643 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.155725:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.155732:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.155734:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.156179:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.156185:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156194:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.156197:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.156201:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156211:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156220:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156229:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156248:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.156260:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.156266:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156274:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.156277:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156342:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156356:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156363:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ef7b3a6/0xbb972366037fe64a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156377:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.156379:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.156380:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.156792:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.156798:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156807:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.156810:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.156815:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156824:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156832:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156848:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156861:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.156869:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.156874:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156880:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafffe00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.156883:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156890:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156901:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156908:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095ec4d68/0xbb972366037fe651 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.156919:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.156921:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.156922:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.157322:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.157335:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157344:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.157347:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.157351:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157360:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157367:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157373:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157387:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.157395:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.157398:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157404:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bafff200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.157408:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157414:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157432:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157439:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dc0138b/0xbb972366037fe658 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.157452:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.157454:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.157456:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.169101:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.169116:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169133:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.169137:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.169143:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169157:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169167:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169174:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169227:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.169244:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.169250:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169257:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.169261:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169269:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169299:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169307:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e53615c5/0xbb972366037fe65f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.169329:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.169330:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.169332:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.172456:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.172471:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172488:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.172503:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.172509:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172523:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172533:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172539:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172557:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.172571:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.172576:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172584:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.172588:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172596:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172612:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172631:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe666 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.172652:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.172654:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.172656:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.178474:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.178485:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178501:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.178506:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.178512:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178526:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178537:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178544:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178569:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.178582:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.178595:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178602:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.178606:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178614:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178631:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178637:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe66d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.178657:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.178659:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.178660:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.184518:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.184530:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184547:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.184558:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.184565:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184593:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184604:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184612:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184633:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.184646:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.184651:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184659:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.184664:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184672:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184689:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184697:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe674 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.184720:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.184721:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.184723:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.189991:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.190005:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190605:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.190610:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.190617:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190634:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190645:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190654:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190687:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.190699:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.190705:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190728:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.190734:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190743:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190777:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190787:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe67b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.190805:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.190807:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.190809:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.191466:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.191474:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191486:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.191490:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.191495:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191507:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191522:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191530:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191549:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.191561:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.191565:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191572:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.191575:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191583:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191596:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191604:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe682 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.191620:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.191627:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.191629:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.192076:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.192083:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192092:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.192096:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.192100:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192111:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192120:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192127:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192143:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.192152:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.192157:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192164:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.192167:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192186:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192197:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192204:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe689 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192218:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.192220:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.192221:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.192620:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.192626:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192633:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.192636:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.192640:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192650:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192657:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192672:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192687:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480180.192695:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.192698:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192705:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:2.0:1789480180.192709:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192716:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192726:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192733:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe690 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.192746:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.192748:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.192749:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480180.210604:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789480180.210619:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.210636:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1789480180.210640:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480180.210647:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.210662:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.210673:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.210681:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.210703:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480180.212270:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480180.212354:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.212367:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.212372:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.212382:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.212420:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.212428:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b47936/0xbb972366037fe697 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.212448:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.212450:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.212452:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.215948:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.215981:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.215999:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.216003:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.216010:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.216026:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.216036:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.216044:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.216071:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480180.216447:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480180.216455:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.216464:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.216469:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.216479:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.216500:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.216507:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab4822e/0xbb972366037fe69e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.216539:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.216541:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.216543:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.219483:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.219498:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.219516:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.219520:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.219528:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.219542:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.219563:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.219571:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.219590:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480180.220450:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480180.220459:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.220468:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.220472:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.220481:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.220497:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.220504:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a88864/0xbb972366037fe6a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.220535:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.220537:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.220539:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480180.227211:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.227227:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227245:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.227250:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.227257:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227273:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227308:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227315:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227348:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480180.227799:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.227805:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227815:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.227818:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.227822:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227831:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227839:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227846:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227860:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789480180.231466:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.231485:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.231502:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.231513:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.231520:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.231534:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.231546:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.231554:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.231567:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789480180.232194:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789480180.232202:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480180.233183:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.233193:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.233206:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.233968:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.233977:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.233992:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.234003:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.234020:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.234031:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789480180.235202:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.235210:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.235222:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.235226:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.235231:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.235243:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.235251:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.235257:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.235266:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789480180.235960:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.235965:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.235975:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.235996:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236003:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a55a976/0xbb972366037fe6ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236026:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789480180.236031:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236036:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.236039:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236045:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236055:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236068:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1343f4/0xbb972366037fe6b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236082:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789480180.236086:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236092:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.236096:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236103:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236113:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236119:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007de86b80/0xbb972366037fe6ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236131:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480180.236135:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236140:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.236149:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236156:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236167:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236174:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037fe6c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236186:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480180.236189:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236196:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.236198:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236205:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236214:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236221:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7af51d/0xbb972366037fe6c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.236240:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.236242:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.236244:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.236256:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789480180.242633:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789480180.242992:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789480180.243003:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.243033:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789480180.243038:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480180.243044:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.243059:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.243071:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.243079:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.243105:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480180.243316:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480180.243324:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.243337:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480180.243351:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.243360:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.243379:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.243386:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083ce5985/0xbb972366037fe6cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.243408:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.243410:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480180.243412:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789480180.243992:0:15012:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1789480180.244124:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14350:x1876405551991552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 145535us (148393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.244134:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480180.250048:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1876405551991552:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789480180.250070:0:14350:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789480180.250240:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1876405551991680:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789480180.250327:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480180.250483:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991680 00000100:00100000:1.0:1789480180.250491:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991680 00000100:00100000:1.0:1789480180.250564:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480180.250573:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14350:x1876405551991680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789480180.250620:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789480180.252498:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291764480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480180.264029:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14350:x1876405551991680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13449us (13693us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789480180.264045:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480180.267978:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1876405551991680:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789480180.268001:0:14350:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789480180.762445:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480181.788692:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789480182.292049:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789480182.292072:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789480182.814536:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480183.834421:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480184.859217:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480185.179332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480185.179341:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789480185.179352:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480185.179363:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1789480185.179370:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789480185.179385:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480185.179412:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551991936:0@lo:400:kworker.0 00000100:00100000:0.0:1789480185.179413:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187733800 x1876405551992192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480185.179681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480185.179750:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789480185.179757:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551991808:0@lo:400:kworker.0 00000100:00100000:2.0:1789480185.179790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480185.179816:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551992448:0@lo:400:kworker.0 00000100:00100000:0.0:1789480185.179821:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991808 00000100:00100000:0.0:1789480185.179830:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991808 00000100:00100000:2.0:1789480185.179842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480185.179867:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551992064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480185.179882:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789480185.179892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480185.179892:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3299:x1876405551991808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480185.179911:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480185.179916:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551992320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480185.179939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480185.179954:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:3299:x1876405551991808:12345-0@lo:400:kworker.0 Request processed in 64us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480185.179962:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789480185.179966:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551992192:0@lo:8:kworker.0 00000100:00100000:2.0:1789480185.179986:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480185.180017:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551991936 00000100:00100000:2.0:1789480185.180021:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551991936 00000100:00100000:2.0:1789480185.180070:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992192 00000100:00100000:2.0:1789480185.180074:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992192 00000100:00100000:2.0:1789480185.180086:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480185.180093:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551991936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480185.180399:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551991936:12345-0@lo:400:kworker.0 Request processed in 306us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480185.180406:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480185.180420:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480185.180425:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876405551992192:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789480185.180446:0:15012:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789480185.181434:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480185.182524:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992064 00000100:00100000:0.0:1789480185.182537:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992064 00000100:00100000:0.0:1789480185.182599:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480185.182609:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551992064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480185.182652:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480185.182766:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551992064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480185.182773:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480185.182806:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992448 00000100:00100000:0.0:1789480185.182811:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992448 00000100:00100000:0.0:1789480185.182848:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992320 00000100:00100000:0.0:1789480185.182851:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992320 00000100:00100000:3.0:1789480185.183000:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480185.183011:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551992448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480185.183055:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551992448:12345-0@lo:400:kworker.0 Request processed in 47us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480185.183061:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480185.183075:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789480185.183081:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551992320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480185.183110:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551992320:12345-0@lo:400:kworker.0 Request processed in 30us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480185.183116:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789480185.183166:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2187731500 x1876405551992320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480185.183184:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551992320:0@lo:400:kworker.0 00000100:00100000:3.0:1789480185.183199:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789480185.183224:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551992064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789480185.185000:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480185.193433:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551991808:0@lo:400:kworker.0 00010000:00080000:0.0:1789480185.193480:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2187731880 x1876405551992448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480185.193494:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551992448:0@lo:400:kworker.0 00000100:00100000:0.0:1789480185.193509:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551991936:0@lo:400:kworker.0 00000100:00100000:2.0:1789480185.200269:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876405551992192:12345-0@lo:8:kworker.0 Request processed in 19827us (20267us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480185.200330:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789480185.200425:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480185.200433:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480185.200438:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551992192:0@lo:8:kworker.0 00010000:00010000:1.0:1789480185.888057:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480186.906446:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480187.419209:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480187.934273:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480188.954401:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789480189.158772:0:15727:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789480189.158778:0:15727:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789480189.158889:0:15727:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d22bb597000 00000020:01000004:0.0:1789480189.158905:0:15727:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789480189.158918:0:15727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789480189.158933:0:15727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d22b99c19c0) 00000020:00000080:0.0:1789480189.158950:0:15727:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789480189.172044:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789480189.172472:0:15727:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789480189.173173:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789480189.173452:0:15727:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789480189.173729:0:15727:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789480189.174111:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 402: rc = 0 00100000:10000000:0.0:1789480189.174226:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 402: rc = 0 00100000:10000000:0.0:1789480189.174355:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 402: rc = 0 00100000:10000000:0.0:1789480189.174861:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:0.0:1789480189.175113:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1789480189.175741:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1789480189.175990:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1789480189.176218:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1789480189.176481:0:15727:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00000020:00000080:2.0:1789480189.177075:0:15727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789480189.177087:0:15727:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789480189.177098:0:15727:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fe6dd 00000020:01000004:2.0:1789480189.177108:0:15727:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789480189.177129:0:15727:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789480189.177133:0:15727:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789480189.177139:0:15727:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789480189.177159:0:15727:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789480189.177163:0:15727:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789480189.188364:0:15727:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789480189.188407:0:15727:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789480189.188412:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789480189.188414:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789480189.188416:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480189.188417:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480189.188418:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480189.188419:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480189.188421:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480189.188422:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480189.188424:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789480189.188427:0:15727:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789480189.188429:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789480189.188435:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789480189.188436:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480189.188437:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480189.188438:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480189.188439:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480189.188440:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789480189.188441:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480189.188442:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789480189.188479:0:15727:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789480189.188501:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789480189.188575:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.188652:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292f443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480189.190987:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992576 00000100:00100000:3.0:1789480189.191002:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992576 00000100:00100000:3.0:1789480189.191082:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480189.191093:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15727:x1876405551992576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789480189.191129:0:14318:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789480189.191133:0:14318:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789480189.191137:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789480189.211494:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15727:x1876405551992576:12345-0@lo:253:mount.lustre.0 Request processed in 20394us (22909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.211510:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480189.211645:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789480189.211675:0:15727:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789480189.211678:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789480189.211680:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789480189.211681:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480189.211683:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480189.211684:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480189.211685:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480189.211686:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480189.211688:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480189.211689:0:15727:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789480189.211710:0:15727:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d22bb597000 from lustre-OST0001 10000000:01000000:3.0:1789480189.211749:0:15727:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789480189.211753:0:15727:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789480189.211761:0:15727:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d22a4acb380 local copy 00010000:00010000:3.0:1789480189.211771:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480189.212006:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480189.212042:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.212086:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.212324:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992704 00000100:00100000:1.0:1789480189.212331:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992704 00000100:00100000:1.0:1789480189.212376:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480189.212385:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15727:x1876405551992704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480189.212635:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15727:x1876405551992704:12345-0@lo:501:mount.lustre.0 Request processed in 251us (592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480189.212644:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789480189.212858:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992704:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789480189.212877:0:15727:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789480189.213025:0:15727:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789480189.213034:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.213044:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22baffe600/0xbb972366037fe48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe491 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480189.213070:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d22bb597000 10000000:01000000:3.0:1789480189.213081:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789480189.213087:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789480189.213089:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480189.213094:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789480189.213097:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789480189.213122:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.213130:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.213140:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480189.213156:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480189.213201:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.213236:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480189.213383:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992832 00000100:00100000:0.0:1789480189.213390:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992832 00000100:00100000:0.0:1789480189.213427:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480189.213435:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:15727:x1876405551992832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480189.213445:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480189.213465:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe6e4 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.213488:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe6e4 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.213498:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e7200/0xbb972366037fe6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe6e4 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.213505:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7200, rc 0) 00000100:00100000:0.0:1789480189.213548:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551992832:12345-0@lo:101:mount.lustre.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.213553:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789480189.214328:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480189.214348:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.214358:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480189.215111:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789480189.220199:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480189.220521:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789480189.220566:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789480189.220618:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789480189.220671:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789480189.220723:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789480189.220759:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789480189.220828:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789480189.220836:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789480189.221623:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480189.221692:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480189.221828:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551992960 00000100:00100000:0.0:1789480189.221837:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551992960 00000100:00100000:0.0:1789480189.221893:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789480189.221902:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551992960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480189.222552:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480189.223611:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551992960:12345-0@lo:501:mount.lustre.0 Request processed in 1704us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.223623:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789480189.223750:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551992960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480189.223806:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480189.223859:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.223951:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480189.224924:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993088 00000100:00100000:2.0:1789480189.224934:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993088 00000100:00100000:2.0:1789480189.225051:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789480189.225060:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480189.228893:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993088:12345-0@lo:503:mount.lustre.0 Request processed in 3825us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.228909:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789480189.229097:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789480189.229901:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789480189.229987:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480189.230045:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.240504:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.241696:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993216 00000100:00100000:1.0:1789480189.241708:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993216 00000100:00100000:1.0:1789480189.241780:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789480189.241788:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480189.242165:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993216:12345-0@lo:502:mount.lustre.0 Request processed in 377us (12119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480189.242322:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480189.242638:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789480189.242698:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789480189.242735:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789480189.242797:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789480189.242839:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789480189.242878:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789480189.242930:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789480189.242965:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789480189.243018:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789480189.243060:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480189.243119:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.243146:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.243304:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789480189.243352:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993344 00000100:00100000:1.0:1789480189.243358:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993344 00000100:00100000:1.0:1789480189.243386:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789480189.243393:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480189.243560:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993344:12345-0@lo:502:mount.lustre.0 Request processed in 166us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.243566:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789480189.243829:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480189.243915:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789480189.243926:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789480189.250793:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789480189.250806:0:15728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789480189.250813:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.250816:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789480189.250823:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480189.250839:0:15728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d229c7dcd40) 00000020:00000080:1.0:1789480189.250864:0:15728:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789480189.250871:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789480189.250931:0:15728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22bb597000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789480189.250939:0:15728:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789480189.250949:0:15728:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb972366037fe6f9 00010000:00010000:0.0:1789480189.266379:0:15728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789480189.266804:0:15728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789480189.268473:0:15728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789480189.279456:0:15728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789480189.279473:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480189.279481:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.279483:0:15728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789480189.279487:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480189.279491:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.279498:0:15728:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789480189.279503:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789480189.279505:0:15728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789480189.279507:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480189.279509:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.279511:0:15728:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789480189.279513:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480189.279515:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.279516:0:15728:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789480189.279519:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789480189.279600:0:15728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480189.279604:0:15728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.279606:0:15728:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789480189.279609:0:15728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789480189.281943:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789480189.281995:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789480189.282026:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.282039:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e4a00/0xbb972366037fe6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe6eb expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480189.282071:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22bb597000 from 1 10000000:01000000:1.0:1789480189.282074:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480189.282116:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.282124:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.282136:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480189.282160:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480189.283020:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480189.283111:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480189.294038:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993472 00000100:00100000:0.0:1789480189.294060:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993472 00000100:00100000:0.0:1789480189.295612:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789480189.295631:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:15727:x1876405551993472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480189.295650:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480189.295669:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe700 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.295701:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.295714:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.295723:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6a00, rc 0) 00000100:00100000:0.0:1789480189.295813:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993472:12345-0@lo:101:mount.lustre.0 Request processed in 188us (12793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.295820:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480189.295942:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480189.295963:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.295973:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480189.296578:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789480189.297075:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480189.297373:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789480189.297420:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789480189.297485:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789480189.297493:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789480189.297577:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480189.297667:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.308959:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993600 00000100:00100000:2.0:1789480189.308976:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993600 00000100:00100000:0.0:1789480189.310849:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789480189.310871:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb2c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480189.311213:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb2c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993600:12345-0@lo:501:mount.lustre.0 Request processed in 351us (13545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.311221:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789480189.313565:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480189.313627:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480189.313695:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480189.313965:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.314049:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.314141:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993728 00000100:00100000:1.0:1789480189.314148:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993728 00000100:00100000:1.0:1789480189.314199:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789480189.314208:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480189.314983:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d229c543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993728:12345-0@lo:503:mount.lustre.0 Request processed in 773us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.314993:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789480189.315099:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993728:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789480189.316681:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789480189.317054:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480189.317124:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.317239:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480189.317440:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993856 00000100:00100000:0.0:1789480189.317448:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993856 00000100:00100000:0.0:1789480189.317527:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789480189.317537:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480189.317821:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993856:12345-0@lo:502:mount.lustre.0 Request processed in 284us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.317829:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789480189.317918:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480189.318183:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789480189.318232:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789480189.318272:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789480189.318328:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789480189.318527:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789480189.318598:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789480189.318635:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789480189.318673:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789480189.318704:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480189.318765:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480189.319475:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.319533:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551993984 00000100:00100000:1.0:1789480189.319540:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551993984 00000100:00100000:1.0:1789480189.319580:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789480189.319599:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480189.319895:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551993984:12345-0@lo:502:mount.lustre.0 Request processed in 307us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.319903:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789480189.320001:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551993984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480189.320125:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789480189.320138:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789480189.321794:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480189.321805:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.321807:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789480189.321814:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22bb597000 00000020:00000080:1.0:1789480189.321816:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789480189.321823:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480189.321824:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.321826:0:15732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789480189.321828:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480189.321830:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.321831:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789480189.321834:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d22bb597000 00000020:00000080:1.0:1789480189.321836:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789480189.321929:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480189.321940:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.321942:0:15732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789480189.321945:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480189.321948:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480189.321949:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480189.321952:0:15732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d22bb597000 00000020:00000080:1.0:1789480189.321953:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480189.331658:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480189.331672:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480189.331674:0:15732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789480189.331682:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789480189.331908:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789480189.331936:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480189.331961:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480189.331975:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480189.332151:0:15727:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789480189.332154:0:15727:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d22bb597000 10000000:01000000:2.0:1789480189.332157:0:15727:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d22bb597000 10000000:01000000:2.0:1789480189.332162:0:15727:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480189.332178:0:15727:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d22bb597000 from 1 10000000:01000000:2.0:1789480189.332181:0:15727:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789480189.332220:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480189.332229:0:15727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480189.332242:0:15727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480189.332267:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480189.332362:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.332399:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.332579:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994112 00000100:00100000:1.0:1789480189.332601:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994112 00000100:00100000:1.0:1789480189.333700:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789480189.333716:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551994112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480189.333733:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480189.333751:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39d200/0xbb972366037fe715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe70e expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.333781:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39d200/0xbb972366037fe715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe70e expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.333793:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39d200/0xbb972366037fe715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe70e expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.333802:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d200, rc 0) 00000100:00100000:1.0:1789480189.333869:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994112:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.333876:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480189.335039:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480189.335066:0:15727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480189.335079:0:15727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480189.335796:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789480189.336157:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480189.336424:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789480189.336500:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789480189.336538:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789480189.336602:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789480189.336659:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789480189.336712:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789480189.336751:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789480189.336784:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789480189.336830:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789480189.336865:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789480189.336900:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789480189.336951:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789480189.336985:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789480189.337015:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789480189.337063:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789480189.337101:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789480189.337133:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789480189.337173:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789480189.337206:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789480189.337235:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789480189.337327:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789480189.337364:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789480189.337397:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789480189.337436:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789480189.337464:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789480189.337490:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789480189.337528:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789480189.337557:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789480189.346397:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789480189.346580:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789480189.346814:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789480189.346862:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789480189.346908:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789480189.346974:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789480189.347040:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789480189.347105:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789480189.347168:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789480189.347332:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789480189.347347:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789480189.347445:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480189.347510:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.347550:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994240 00000100:00100000:2.0:1789480189.347557:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994240 00000100:00100000:2.0:1789480189.347620:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480189.347630:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480189.347880:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994240:12345-0@lo:501:mount.lustre.0 Request processed in 250us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.347889:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480189.347939:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480189.347968:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480189.348006:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480189.348045:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.348074:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.348255:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994368 00000100:00100000:1.0:1789480189.348261:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994368 00000100:00100000:1.0:1789480189.348318:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789480189.348327:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480189.348727:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994368:12345-0@lo:503:mount.lustre.0 Request processed in 401us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.348741:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789480189.349005:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480189.349780:0:15727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480189.349927:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480189.349980:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.350050:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22abd48b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480189.350086:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994496 00000100:00100000:1.0:1789480189.350091:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994496 00000100:00100000:1.0:1789480189.350164:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789480189.350173:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480189.350482:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994496:12345-0@lo:502:mount.lustre.0 Request processed in 309us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.350489:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789480189.350503:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480189.350768:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789480189.350852:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789480189.350907:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789480189.350966:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789480189.351000:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789480189.351038:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789480189.351071:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789480189.351174:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789480189.351225:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789480189.351255:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789480189.351314:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789480189.351380:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789480189.351417:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789480189.351452:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789480189.351499:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789480189.351540:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789480189.351651:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789480189.351715:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789480189.351746:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789480189.351765:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789480189.351836:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789480189.351869:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789480189.351896:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789480189.351932:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789480189.351957:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789480189.351981:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789480189.352016:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789480189.352044:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789480189.352070:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789480189.352107:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789480189.352143:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789480189.352177:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789480189.352208:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789480189.352245:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789480189.352273:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789480189.352347:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789480189.352398:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789480189.352438:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789480189.352476:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789480189.352502:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789480189.352541:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480189.352629:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480189.352670:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c6a3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480189.353099:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994624 00000100:00100000:0.0:1789480189.353107:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994624 00000100:00100000:0.0:1789480189.353154:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789480189.353164:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480189.355620:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551994624:12345-0@lo:502:mount.lustre.0 Request processed in 2450us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.355713:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789480189.357909:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551994624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480189.358057:0:15727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789480189.358073:0:15727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789480189.359938:0:15737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789480189.359967:0:15737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2186a68000) 00000020:00000080:3.0:1789480189.359990:0:15737:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789480189.360070:0:15737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d22bb597000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789480189.360075:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d22bb597000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789480189.360077:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d22bb597000 3 00010000:00080000:3.0:1789480189.360120:0:15737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2185475000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1789480189.364215:0:15737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789480189.364608:0:15737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789480189.364647:0:15737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789480189.364660:0:15737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb972366037fe723 00000100:00080000:2.0:1789480189.364671:0:15737:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789480189.364684:0:15737:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2185475000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480189.364723:0:15737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d218706bb80 x1876405551994752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480189.364759:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551994752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789480189.364822:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789480189.364870:0:15737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789480189.364918:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480189.364922:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480189.364925:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480189.364934:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:2.0:1789480189.364936:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789480189.364942:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1789480189.364955:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2187069880 x1876405551995008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480189.364999:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551994880:0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.365054:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551995264:0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365074:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.365090:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480189.365095:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d218706a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551995136:0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365113:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480189.365138:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994752 00000100:00100000:2.0:1789480189.365145:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994752 00000100:00100000:2.0:1789480189.365167:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995264 00000100:00100000:2.0:1789480189.365169:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995264 00000100:00100000:2.0:1789480189.365199:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995136 00000100:00100000:2.0:1789480189.365202:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995136 00000100:00100000:2.0:1789480189.365218:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480189.365226:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551995264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365274:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405551995264:12345-0@lo:400:kworker.0 Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.365297:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480189.365313:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480189.365317:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551994880 00000100:00100000:2.0:1789480189.365320:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551995136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480189.365322:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551994880 00000100:00100000:2.0:1789480189.365346:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551995136:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.365358:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480189.365362:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480189.365368:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551994880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365370:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480189.365373:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876405551994752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789480189.365408:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1789480189.365437:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb972366037fe72a 00000004:00100000:2.0:1789480189.365452:0:14327:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789480189.365480:0:14327:0:(import.c:65:import_set_state_nolock()) ffff8d2187014000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480189.365514:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876405551994752:12345-0@lo:38:llog_process_th.0 Request processed in 139us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.365520:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789480189.365541:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480189.365545:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789480189.365568:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d218706a300 x1876405551995136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480189.365581:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551995136:0@lo:400:kworker.0 00010000:00080000:2.0:1789480189.365607:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d218706b100 x1876405551995264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480189.365615:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405551995264:0@lo:400:kworker.0 00000100:00100000:2.0:1789480189.365641:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551995008:0@lo:8:kworker.0 00000100:00100000:2.0:1789480189.365664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789480189.365687:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d218706bb80 x1876405551994752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480189.365694:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789480189.365700:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789480189.365712:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789480189.365717:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789480189.365719:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d2185475000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789480189.365724:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d218706bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876405551994752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789480189.365749:0:15012:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789480189.365755:0:15012:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789480189.365956:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551994880:12345-0@lo:400:kworker.0 Request processed in 588us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.365963:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480189.365977:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995008 00000100:00100000:1.0:1789480189.365981:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995008 00000100:00100000:1.0:1789480189.365993:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480189.365997:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551994880:0@lo:400:kworker.0 00000100:00100000:1.0:1789480189.365998:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551995008:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789480189.366039:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551995008:12345-0@lo:8:kworker.0 Request processed in 39us (374us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789480189.366045:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480189.367188:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789480189.367198:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480189.367203:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789480189.367207:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551995008:0@lo:8:kworker.0 00000040:00080000:2.0:1789480189.370251:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789480189.370698:0:15727:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789480189.370728:0:15727:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789480189.370754:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.370778:0:15727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d2187646600/0xbb972366037fe70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe715 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789480189.370911:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789480189.370914:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789480189.370916:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480189.370917:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480189.370918:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480189.370920:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480189.370921:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480189.370923:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480189.370924:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480189.370928:0:15727:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789480189.370930:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480189.370931:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789480189.370933:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480189.370934:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480189.370935:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480189.370936:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480189.370937:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480189.370938:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480189.370939:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480189.370965:0:15727:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789480189.370987:0:15727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551995392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480189.371057:0:15727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480189.371118:0:15727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22832eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480189.371954:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995392 00000100:00100000:2.0:1789480189.371963:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995392 00000100:00100000:2.0:1789480189.372024:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789480189.372034:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:15727:x1876405551995392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480189.372061:0:14320:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789480189.372074:0:14320:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789480189.401861:0:14320:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789480189.401880:0:14320:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789480189.401906:0:14342:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789480189.401912:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789480189.401934:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.401953:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe604 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.401977:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.402016:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.402032:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 19 pid: 14318 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480189.402046:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551995520:0@lo:104: 00000100:00100000:1.0:1789480189.402108:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480189.402150:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2285e87840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480189.402507:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995520 00000100:00100000:2.0:1789480189.402516:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995520 00000100:00100000:2.0:1789480189.402559:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480189.402569:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551995520:12345-0@lo:104: 00010000:00010000:2.0:1789480189.402597:0:14310:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480189.402693:0:14310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789480189.402699:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:14342:x1876405551995520:12345-0@lo:104: Request processed in 133us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480189.402706:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480189.402716:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14342:1876405551995520:0@lo:104: 00010000:00010000:1.0:1789480189.402734:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402780:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480189.402787:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402794:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5e00 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480189.402798:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402807:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480189.402813:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480189.402819:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480189.402864:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402871:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480189.402896:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402904:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe60b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480189.402920:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480189.402921:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480189.402923:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480189.402930:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480189.402942:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551995648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480189.402975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480189.403256:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995648 00000100:00100000:0.0:1789480189.403261:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995648 00010000:00010000:0.0:1789480189.403847:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 20 pid: 14318 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480189.403876:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480189.403885:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+20:3299:x1876405551995648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480189.403906:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480189.403912:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 20 pid: 14318 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.403925:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 20 pid: 14318 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.403940:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22baffe400/0xbb972366037fe60b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe604 expref: 20 pid: 14318 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404082:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404092:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789480189.404108:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010943832s 00010000:00010000:0.0:1789480189.404113:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404120:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404127:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404133:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404138:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39da00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480189.404142:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.404157:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.406434:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480189.406460:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480189.406648:0:14342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.406659:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480189.406666:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe731 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480189.406787:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3299:x1876405551995648:12345-0@lo:103:ldlm_bl.0 Request processed in 2900us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480189.406796:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480189.408232:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551995648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480189.423008:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:15727:x1876405551995392:12345-0@lo:253:mount.lustre.0 Request processed in 50965us (51940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480189.423025:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789480189.423130:0:15727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:15727:1876405551995392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480189.423147:0:15727:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789480189.423150:0:15727:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480189.423152:0:15727:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789480189.423153:0:15727:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480189.423155:0:15727:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480189.423156:0:15727:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480189.423158:0:15727:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480189.423159:0:15727:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480189.423161:0:15727:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480189.423231:0:15727:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789480189.423247:0:15727:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789480189.430275:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480189.430984:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480189.431322:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480189.431715:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789480189.431867:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789480189.432171:0:15727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789480189.433418:0:15727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789480189.491490:0:15727:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789480189.491499:0:15727:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789480189.491538:0:15727:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789480189.491606:0:15727:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789480189.491620:0:15727:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789480189.491652:0:15727:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789480189.978448:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480190.303485:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551995776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480190.303562:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480190.303670:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995776 00000100:00100000:3.0:1789480190.303678:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995776 00000100:00100000:3.0:1789480190.303727:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480190.303737:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551995776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480190.303771:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480190.303817:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551995776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480190.303825:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480190.303885:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551995776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480191.002588:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480191.322670:0:14324:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789480191.322677:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2187178000 from 8 10000000:01000000:3.0:1789480191.322682:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789480191.322730:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480191.322743:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480191.322756:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480191.322781:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551995904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480191.322850:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480191.322909:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480191.322969:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551995904 00000100:00100000:1.0:1789480191.322978:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551995904 00000100:00100000:1.0:1789480191.323031:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789480191.323041:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405551995904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480191.323055:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480191.323068:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39d600/0xbb972366037fe73f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe738 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480191.323090:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39d600/0xbb972366037fe73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe738 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480191.323101:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39d600/0xbb972366037fe73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe738 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480191.323110:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d600, rc 0) 00000100:00100000:1.0:1789480191.323146:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405551995904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480191.323153:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789480191.323794:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551995904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480191.323813:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480191.323822:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480191.323878:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551996032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789480191.323914:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480191.323980:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d218566f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480191.325851:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996032 00000100:00100000:1.0:1789480191.325863:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996032 00000100:00100000:1.0:1789480191.325964:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789480191.325978:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405551996032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789480191.326009:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789480191.326027:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789480191.326032:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789480191.326167:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405551996032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480191.326175:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789480191.326410:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405551996032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789480191.326591:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789480191.326602:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480191.326614:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22a48e5e00/0xbb972366037fe738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe73f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.026990:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480193.068764:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.074649:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480194.396799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480194.396808:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789480194.396812:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480194.396833:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d22a0282800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1789480194.396860:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d22bab44e00 x1876405551996416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480194.396950:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551996416:0@lo:8:kworker.0 00000100:00100000:1.0:1789480194.397039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480194.397129:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551996544:0@lo:400:kworker.0 00000100:00100000:1.0:1789480194.397160:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480194.397195:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480194.397202:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551996672:0@lo:400:kworker.0 00000100:00100000:1.0:1789480194.397226:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480194.397263:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996416 00000100:00100000:1.0:1789480194.397272:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996416 00000100:00100000:1.0:1789480194.397332:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480194.397341:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876405551996416:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789480194.397375:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1789480194.397413:0:15010:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb972366037fe746 00002000:00100000:1.0:1789480194.397430:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d218785b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789480194.397435:0:15010:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789480194.397439:0:15010:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789480194.397851:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480194.397880:0:15010:0:(import.c:65:import_set_state_nolock()) ffff8d218785f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480194.397936:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876405551996416:12345-0@lo:8:kworker.0 Request processed in 594us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480194.397944:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480194.397977:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996544 00000100:00100000:1.0:1789480194.397981:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996544 00000100:00100000:1.0:1789480194.398009:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996672 00000100:00100000:1.0:1789480194.398012:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996672 00000100:00100000:1.0:1789480194.398039:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480194.398045:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480194.398081:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551996544:12345-0@lo:400:kworker.0 Request processed in 36us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480194.398087:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480194.398100:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480194.398106:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551996672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480194.398139:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551996672:12345-0@lo:400:kworker.0 Request processed in 33us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480194.398145:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789480194.398169:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789480194.398200:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bab46a00 x1876405551996672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480194.398215:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551996672:0@lo:400:kworker.0 00010000:00080000:1.0:1789480194.398225:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bab47480 x1876405551996544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480194.398233:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551996544:0@lo:400:kworker.0 00010000:00080000:1.0:1789480194.398263:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bab44e00 x1876405551996416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480194.398275:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789480194.398304:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789480194.398310:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789480194.398313:0:3297:0:(import.c:65:import_set_state_nolock()) ffff8d22a0282800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789480194.398325:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789480194.398330:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876405551996416:0@lo:8:kworker.0 00000004:00080000:1.0:1789480194.398368:0:14352:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1789480194.398384:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1876405551997056:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789480194.398410:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480194.398428:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789480194.398441:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997056 00000100:00100000:1.0:1789480194.398445:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997056 00000100:00100000:1.0:1789480194.398501:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480194.398509:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14352:x1876405551997056:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789480194.399569:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551996288:0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.399621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.399669:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551996928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480194.399700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.399724:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789480194.399731:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405551996160:0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.399775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.399799:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551996800:0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.399827:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789480194.399876:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480194.399895:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996288 00000100:00100000:0.0:1789480194.399902:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996288 00000100:00100000:0.0:1789480194.399945:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789480194.399953:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551996288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.399995:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551996288:12345-0@lo:400:kworker.0 Request processed in 43us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480194.400002:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789480194.400017:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480194.400041:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551996288:0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.400069:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996800 00000100:00100000:0.0:1789480194.400072:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996800 00000100:00100000:0.0:1789480194.400099:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789480194.400106:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551996800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480194.400136:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551996800:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480194.400142:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789480194.400154:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789480194.400169:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bab44700 x1876405551996800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480194.400180:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551996800:0@lo:400:kworker.0 00000004:00080000:3.0:1789480194.400321:0:14351:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789480194.400781:0:14351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487397498177ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789480194.400831:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996928 00000100:00100000:3.0:1789480194.400837:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996928 00000100:00100000:3.0:1789480194.400871:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480194.400879:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551996928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480194.400908:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480194.400959:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876405551996928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480194.400966:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480194.400985:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551996160 00000100:00100000:3.0:1789480194.400989:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551996160 00000100:00100000:3.0:1789480194.401013:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789480194.401019:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405551996160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480194.401049:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405551996160:12345-0@lo:400:kworker.0 Request processed in 31us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480194.401055:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789480194.401100:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405551996160:0@lo:400:kworker.0 00010000:00080000:3.0:1789480194.401114:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bab44e00 x1876405551996928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480194.401129:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551996928:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1789480194.407504:0:15012:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789480194.407520:0:15012:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789480194.407528:0:15012:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1789480194.416159:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.416175:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416197:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.416202:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.416211:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416233:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416246:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416255:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416314:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.416332:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.416339:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416360:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.416366:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416377:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416397:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416405:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe74d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.416425:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.416427:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.416428:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.417211:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.417219:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417231:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.417236:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.417241:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417252:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417268:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417275:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417322:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.417334:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.417339:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417348:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.417352:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417362:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417378:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417385:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005950aad8/0xbb972366037fe754 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417400:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.417407:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.417409:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.417847:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.417854:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.417864:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.417867:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.417872:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.421781:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.421820:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.421829:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.421860:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480194.421964:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480194.421973:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.421983:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ca00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480194.421988:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.422007:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.422037:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.422046:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc92693/0xbb972366037fe75b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.422085:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.422087:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.422089:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.424705:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.424720:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.424743:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.424748:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.424756:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.424781:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.424794:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.424802:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.424828:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480194.425228:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.425235:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425244:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.425248:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.425252:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425262:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425271:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425319:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425337:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789480194.425352:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480194.425359:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425368:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.425374:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425385:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425406:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425415:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ce33f5/0xbb972366037fe762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425434:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.425438:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425458:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39da00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.425461:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425469:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425479:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425500:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027870cfc/0xbb972366037fe769 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425514:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.425516:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.425517:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.425942:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.425950:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425959:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.425962:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.425967:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425978:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.425992:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426001:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426014:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.426022:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.426026:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426033:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39de00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.426037:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426046:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426060:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426067:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016eba47d/0xbb972366037fe770 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426081:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.426087:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.426089:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.426534:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.426541:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426551:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.426554:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.426559:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426570:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426578:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426587:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426602:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.426610:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.426614:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426621:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.426624:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426661:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426674:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426682:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000044aa016/0xbb972366037fe777 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.426696:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.426697:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.426699:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.427029:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.430259:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.430275:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430318:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.430324:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.430331:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430348:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430362:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430378:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430399:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.430415:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.430421:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430431:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.430436:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430447:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430467:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430474:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e73dc51/0xbb972366037fe77e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430508:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.430510:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.430512:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.430945:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.430959:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430968:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.430972:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.430976:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430986:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430993:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.430999:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431020:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.431030:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.431035:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431042:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39cc00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.431046:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431054:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431152:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431160:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ea7a81/0xbb972366037fe785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431178:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.431180:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.431182:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.431653:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.431660:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431670:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.431673:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.431677:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431686:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431695:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431701:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431726:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.431736:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.431742:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431749:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.431752:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431760:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431773:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431782:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010b6db7d/0xbb972366037fe78c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.431797:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.431798:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.431800:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.432341:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.432348:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432359:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.432367:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.432372:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432382:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432392:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432400:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432415:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.432424:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.432429:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432437:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.432441:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432455:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432467:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432496:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.432513:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.432515:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.432517:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.433041:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.433049:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433059:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.433063:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.433082:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433093:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433103:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433111:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433127:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.433135:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.433147:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433155:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.433159:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433167:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433178:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433186:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe79a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433200:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.433202:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.433204:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.433676:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.433682:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433693:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.433696:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.433701:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433722:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433732:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433740:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433756:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.433765:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.433770:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433778:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.433782:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433791:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433805:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433813:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.433834:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.433836:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.433838:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.434246:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.434253:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434262:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.434265:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.434269:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434279:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434335:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434342:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434357:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.434366:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.434370:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434388:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.434392:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434399:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434413:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434420:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434433:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.434435:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.434436:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.434846:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.434853:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434862:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.434865:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.434869:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434880:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434894:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434901:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434916:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.434925:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.434930:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434937:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.434940:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434948:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434959:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434967:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.434981:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.434987:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.434989:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.435406:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.435412:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.435421:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.435425:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.435429:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.435440:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.435449:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.435457:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.435471:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.435478:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.435481:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.438416:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146400 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.438425:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.438456:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.438483:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.438503:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069cbecd5/0xbb972366037fe7b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.438533:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.438536:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.438538:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.439238:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.439246:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439261:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.439267:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.439274:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439316:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439327:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439342:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439363:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480194.439810:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.439816:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439826:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.439829:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.439833:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439843:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439851:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439858:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439879:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789480194.439892:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480194.439898:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439912:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147200 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.439916:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439926:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439944:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439952:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082629aff/0xbb972366037fe7bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439972:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.439976:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439983:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.439986:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.439994:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440004:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440018:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39fb389/0xbb972366037fe7c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440033:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.440035:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.440036:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.440480:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.440502:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440512:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.440517:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.440521:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440533:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440543:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440551:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440568:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.440576:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.440585:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440594:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.440597:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440606:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440621:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440629:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d1ee0fd/0xbb972366037fe7cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.440644:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.440645:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.440647:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.441085:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.441091:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441101:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.441104:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.441109:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441129:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441137:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441144:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441158:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480194.441940:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480194.441949:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441961:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147000 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480194.441966:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441976:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.441995:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.442002:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3a7070d/0xbb972366037fe7d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.442028:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.442030:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.442032:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.443599:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.444052:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.444065:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444096:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.444101:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.444108:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444125:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444136:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444145:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444162:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480194.444708:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.444716:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444736:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.444739:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.444743:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444753:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444762:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444770:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.444789:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789480194.445191:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.445197:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445205:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.445208:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.445213:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445222:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445241:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445249:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445257:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789480194.445684:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.445689:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445698:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.445702:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.445706:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445716:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445724:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445732:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.445750:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789480194.446147:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789480194.446156:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446172:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146e00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.446177:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446188:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446210:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446218:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0bb253f/0xbb972366037fe7d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446241:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789480194.446245:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446251:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.446254:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446261:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446269:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446312:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af4014c/0xbb972366037fe7e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446325:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480194.446329:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446336:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.446339:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446347:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446355:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446362:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867f0f0a/0xbb972366037fe7e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446373:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480194.446376:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446382:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.446390:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446398:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446406:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446413:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad3ea2e/0xbb972366037fe7ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.446425:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480194.446427:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480194.446429:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480194.446797:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.446804:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.446816:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.446819:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.446824:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.446836:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.446844:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.446852:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.446898:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480194.447396:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.447403:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.447412:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.447420:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.447425:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.447435:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.447443:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.447450:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447581:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480194.447587:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447595:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146600 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.447599:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447608:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447623:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447637:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ca24816/0xbb972366037fe7f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447654:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480194.447657:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447663:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2147c00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:0.0:1789480194.447666:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447674:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447683:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.447689:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480194.447690:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480194.447692:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480194.447746:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789480194.447750:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045939877/0xbb972366037fe7fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480194.448188:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.448194:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448204:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.448207:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.448211:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448220:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448235:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448242:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448251:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480194.448671:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789480194.448677:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448687:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789480194.448690:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480194.448694:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448704:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448713:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448722:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.448741:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1789480194.448921:0:15012:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1789480194.449052:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14352:x1876405551997056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 50538us (50634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480194.449063:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480194.449145:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1876405551997056:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789480194.449164:0:14352:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1789480194.449225:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1876405551997184:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789480194.449265:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480194.449331:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229044fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789480194.449356:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997184 00000100:00100000:1.0:1789480194.449363:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997184 00000100:00100000:1.0:1789480194.449409:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480194.449417:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1876405551997184:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789480194.449462:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789480194.450674:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480194.450686:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450700:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22c2146a00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480194.450705:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450717:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450739:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450754:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed71e0a/0xbb972366037fe803 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450783:0:14314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480194.450787:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450795:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480194.450798:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450807:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450816:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450823:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000832bc8a6/0xbb972366037fe80a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.450835:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.450837:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480194.450839:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789480194.452085:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789480194.452202:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480194.458216:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14352:x1876405551997184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8787us (8939us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789480194.458234:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480194.458453:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1876405551997184:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789480194.458474:0:14352:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:0.0:1789480195.044146:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789480195.044196:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789480195.112781:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480195.420844:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551997312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480195.420926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480195.421017:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997312 00000100:00100000:0.0:1789480195.421026:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997312 00000100:00100000:0.0:1789480195.421091:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480195.421102:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551997312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480195.421139:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480195.421189:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551997312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480195.421196:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480195.421355:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551997312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789480196.122475:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480197.160969:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480197.219087:0:16085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789480197.661436:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789480198.170843:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480199.195130:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480199.517458:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551997440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480199.517531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480199.517611:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997440 00000100:00100000:1.0:1789480199.517619:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997440 00000100:00100000:1.0:1789480199.517700:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480199.517709:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551997440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480199.517742:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480199.517787:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551997440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480199.517794:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480199.517843:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789480199.517866:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551997440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480199.518684:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480199.518696:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405551997568:0@lo:400:kworker.0 00000100:00100000:3.0:1789480199.518740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480199.518795:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551997696:0@lo:400:kworker.0 00000100:00100000:3.0:1789480199.518823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480199.518873:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997696 00000100:00100000:3.0:1789480199.518880:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997696 00000100:00100000:3.0:1789480199.518929:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480199.518938:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551997696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480199.518979:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551997696:12345-0@lo:400:kworker.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480199.518986:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480199.519018:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551997696:0@lo:400:kworker.0 00000100:00100000:3.0:1789480199.519067:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480199.519074:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551998080:0@lo:400:kworker.0 00000100:00100000:3.0:1789480199.519103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480199.522239:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997568 00000100:00100000:1.0:1789480199.522254:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997568 00000100:00100000:1.0:1789480199.522334:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789480199.522345:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405551997568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522444:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405551997568:12345-0@lo:400:kworker.0 Request processed in 101us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480199.522462:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789480199.522503:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551997824:0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480199.522566:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480199.522574:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551997952:0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480199.522632:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998080 00000100:00100000:1.0:1789480199.522636:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998080 00000100:00100000:1.0:1789480199.522674:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997824 00000100:00100000:1.0:1789480199.522677:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997824 00000100:00100000:1.0:1789480199.522688:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551997952 00000100:00100000:1.0:1789480199.522690:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551997952 00000100:00100000:1.0:1789480199.522703:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480199.522720:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551998080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522756:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405551998080:12345-0@lo:400:kworker.0 Request processed in 36us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480199.522762:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480199.522775:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789480199.522782:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551997824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522813:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405551997824:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480199.522818:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789480199.522843:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789480199.522849:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.522872:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551997952:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480199.522877:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789480199.523111:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd681880 x1876405551997952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480199.523125:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551997952:0@lo:400:kworker.0 00010000:00080000:1.0:1789480199.523136:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd681f80 x1876405551997824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480199.523144:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405551997824:0@lo:400:kworker.0 00010000:00080000:1.0:1789480199.523176:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d22bd683100 x1876405551998080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480199.523185:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405551998080:0@lo:400:kworker.0 00000100:00100000:1.0:1789480199.523204:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405551997568:0@lo:400:kworker.0 00000100:00080000:0.0:1789480199.530780:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480199.530791:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480199.530795:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789480200.220258:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480200.545778:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480200.545805:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551998208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480200.545875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480200.546188:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998208 00000100:00100000:0.0:1789480200.546197:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998208 00000100:00100000:0.0:1789480200.546255:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480200.546265:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551998208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480200.546329:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480200.546403:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551998208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480200.546410:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480200.546675:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551998208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480200.562812:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.562981:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526831744 00000100:00100000:3.0:1789480200.562991:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526831744 00000100:00100000:3.0:1789480200.563038:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1789480200.563046:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1876405526831744:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789480200.563085:0:14321:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2e88bdc8-7812-42b9-968b-c1d53a5bbc1d@192.168.204.54@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:3.0:1789480200.563113:0:14321:0:(genops.c:1384:class_connect()) connect: client 2e88bdc8-7812-42b9-968b-c1d53a5bbc1d, cookie 0xbb972366037fe811 00000100:00080000:3.0:1789480200.563249:0:14321:0:(import.c:65:import_set_state_nolock()) ffff8d2185475800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480200.563354:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+5:2344:x1876405526831744:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 307us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480200.563361:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1789480200.586414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.586556:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526831872 00000100:00100000:1.0:1789480200.586575:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526831872 00000100:00100000:1.0:1789480200.586665:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1789480200.586679:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bf7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+5:13720:x1876405526831872:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789480200.586698:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480200.586718:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f354b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.586748:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f354b expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.586760:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39da00/0xbb972366037fe818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f354b expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.586769:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39da00, rc 0) 00000100:00100000:1.0:1789480200.586843:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bf7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+6:13720:x1876405526831872:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 167us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.586850:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1789480200.589520:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.589723:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832000 00000100:00100000:1.0:1789480200.589734:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832000 00000100:00100000:1.0:1789480200.589813:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1789480200.589825:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+6:13720:x1876405526832000:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480200.590918:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+6:13720:x1876405526832000:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1087us (1404us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480200.590931:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1789480200.594188:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.594594:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832128 00000100:00100000:1.0:1789480200.594609:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832128 00000100:00100000:1.0:1789480200.594691:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1789480200.594703:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+6:13720:x1876405526832128:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789480200.594726:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480200.594752:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39d800/0xbb972366037fe81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3552 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.594795:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39d800/0xbb972366037fe81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3552 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.594808:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39d800/0xbb972366037fe81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3552 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480200.594817:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d800, rc 0) 00000100:00100000:1.0:1789480200.594961:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+7:13720:x1876405526832128:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 260us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.594969:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1789480200.605165:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.605329:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832256 00000100:00100000:3.0:1789480200.605342:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832256 00000100:00100000:3.0:1789480200.605438:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1789480200.605452:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+7:13720:x1876405526832256:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789480200.605845:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13720:x1876405526832256:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 395us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480200.605853:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1789480200.615067:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.618633:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832384 00000100:00100000:2.0:1789480200.618656:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832384 00000100:00100000:2.0:1789480200.618752:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789480200.618766:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13720:x1876405526832384:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789480200.621932:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13720:x1876405526832384:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 3152us (6864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.621963:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1789480200.640999:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.641162:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832512 00000100:00100000:1.0:1789480200.641176:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832512 00000100:00100000:1.0:1789480200.641266:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1789480200.641313:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13740:x1876405526832512:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480200.641755:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13740:x1876405526832512:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 475us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.641764:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1789480200.678194:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.678439:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832640 00000100:00100000:2.0:1789480200.678454:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832640 00000100:00100000:2.0:1789480200.678525:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1789480200.678537:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13740:x1876405526832640:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480200.678911:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13740:x1876405526832640:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 375us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.678930:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:0.0:1789480200.690889:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.702699:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832768 00000100:00100000:3.0:1789480200.702723:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832768 00000100:00100000:3.0:1789480200.702825:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1789480200.702838:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+8:13720:x1876405526832768:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789480200.702866:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480200.702891:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4200/0xbb972366037fe826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f357c expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.702930:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4200/0xbb972366037fe826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f357c expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.702991:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4200/0xbb972366037fe826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f357c expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.703002:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4200, rc 0) 00000100:00100000:3.0:1789480200.703099:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+9:13720:x1876405526832768:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 263us (12226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480200.703106:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1789480200.719580:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.726146:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526832896 00000100:00100000:2.0:1789480200.726168:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526832896 00000100:00100000:2.0:1789480200.726648:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1789480200.726662:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+9:13720:x1876405526832896:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789480200.726699:0:14320:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789480200.726733:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789480200.726737:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789480200.726740:0:14320:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789480200.726743:0:14320:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789480200.731541:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+9:13720:x1876405526832896:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 4865us (11958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.731577:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1789480200.739766:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.739853:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833024 00000100:00100000:3.0:1789480200.739867:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833024 00000100:00100000:3.0:1789480200.739947:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1789480200.739959:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+9:13720:x1876405526833024:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789480200.740057:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480200.740083:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3583 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.740123:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.740135:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480200.740146:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5c00, rc 0) 00000100:00100000:0.0:1789480200.741906:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13720:x1876405526833024:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 1935us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480200.741952:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1789480200.744582:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.744860:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833152 00000100:00100000:1.0:1789480200.744873:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833152 00000100:00100000:1.0:1789480200.745020:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:1.0:1789480200.745032:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13720:x1876405526833152:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480200.745514:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13720:x1876405526833152:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 483us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.745523:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1789480200.748841:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.750596:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833280 00000100:00100000:3.0:1789480200.750614:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833280 00000100:00100000:2.0:1789480200.750969:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:2.0:1789480200.750985:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13720:x1876405526833280:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789480200.751899:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13720:x1876405526833280:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 909us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.751911:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1789480200.756412:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.756578:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833408 00000100:00100000:2.0:1789480200.756591:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833408 00000100:00100000:2.0:1789480200.756702:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789480200.756714:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13746:x1876405526833408:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480200.757119:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13746:x1876405526833408:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 406us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.757130:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:2.0:1789480200.768489:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480200.768753:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833536 00000100:00100000:0.0:1789480200.768767:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833536 00000100:00100000:0.0:1789480200.768841:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1789480200.768853:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218566a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13746:x1876405526833536:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480200.769910:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218566a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13746:x1876405526833536:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 1051us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480200.771260:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:3.0:1789480200.780405:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.781256:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833664 00000100:00100000:1.0:1789480200.781273:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833664 00000100:00100000:1.0:1789480200.781605:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1789480200.781616:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1876405526833664:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789480200.781659:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 11a5fd0e-73e8-4c23-8b68-dd708fa09a05@192.168.204.54@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1789480200.781796:0:14328:0:(genops.c:1384:class_connect()) connect: client 11a5fd0e-73e8-4c23-8b68-dd708fa09a05, cookie 0xbb972366037fe834 00000004:00100000:1.0:1789480200.781837:0:14328:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789480200.781845:0:14328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789480200.855894:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8d2187012000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480200.857095:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2344:x1876405526833664:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 75467us (76890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480200.857112:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480200.860719:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480200.860780:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.861334:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833792 00000100:00100000:2.0:1789480200.861346:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833792 00000100:00100000:2.0:1789480200.861460:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526833920 00000100:00100000:2.0:1789480200.861465:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526833920 00000100:00100000:2.0:1789480200.861484:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789480200.861495:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:0:x1876405526833792:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789480200.861554:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789480200.861676:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:0:x1876405526833792:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 181us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.861685:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1789480200.861708:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789480200.861714:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526833920:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789480200.861727:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789480200.861896:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526833920:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 37us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480200.861907:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00080000:1.0:1789480200.862470:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480200.868089:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480200.868352:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834048 00000100:00100000:1.0:1789480200.868376:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834048 00000100:00100000:1.0:1789480200.868575:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789480200.868587:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526834048:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789480200.868720:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526834048:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 135us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.868749:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480200.875374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.877690:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480200.877728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480200.877943:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834176 00000100:00100000:3.0:1789480200.877947:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834432 00000100:00100000:0.0:1789480200.877958:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834176 00000100:00100000:3.0:1789480200.877959:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834432 00000100:00100000:3.0:1789480200.878043:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480200.878056:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526834432:12345-192.168.204.54@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789480200.878070:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834304 00000100:00100000:0.0:1789480200.878075:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834304 00000100:00100000:0.0:1789480200.878097:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789480200.878103:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1876405526834176:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789480200.878148:0:15012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 11a5fd0e-73e8-4c23-8b68-dd708fa09a05@192.168.204.54@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:0.0:1789480200.878202:0:15012:0:(genops.c:1384:class_connect()) connect: client 11a5fd0e-73e8-4c23-8b68-dd708fa09a05, cookie 0xbb972366037fe83b 00002000:00100000:0.0:1789480200.878421:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11a5fd0e-73e8-4c23-8b68-dd708fa09a05/ffff8d22aea57000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789480200.878438:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789480200.878856:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789480200.878864:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1876405526834304:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789480200.878888:0:15010:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 11a5fd0e-73e8-4c23-8b68-dd708fa09a05@192.168.204.54@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1789480200.878913:0:15010:0:(genops.c:1384:class_connect()) connect: client 11a5fd0e-73e8-4c23-8b68-dd708fa09a05, cookie 0xbb972366037fe842 00002000:00100000:1.0:1789480200.878919:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11a5fd0e-73e8-4c23-8b68-dd708fa09a05/ffff8d218785e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480200.878926:0:15010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00080000:3.0:1789480200.880391:0:14329:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2235us 00002000:00080000:0.0:1789480200.882137:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789480200.882204:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8d22aea55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480200.882354:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2344:x1876405526834176:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 4247us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480200.882375:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00002000:00080000:1.0:1789480200.882683:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480200.882703:0:15010:0:(import.c:65:import_set_state_nolock()) ffff8d218785b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480200.882731:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2344:x1876405526834304:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 3866us (5002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480200.882739:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000004:00200000:3.0:1789480200.910836:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789480200.911167:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13720:x1876405526834432:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 33107us (35810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480200.911178:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789480201.157754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480201.159895:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834560 00000100:00100000:0.0:1789480201.160095:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834560 00000100:00100000:0.0:1789480201.160402:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480201.160416:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13767:x1876405526834560:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:0.0:1789480201.160446:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480201.160483:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f35ad expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160574:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160592:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160730:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480201.160781:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789480201.160786:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480201.160833:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160864:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35ad expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160888:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35ad expref: 7 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.160897:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:0.0:1789480201.160899:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480201.160904:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6400, rc 0) 00000100:00100000:0.0:1789480201.162274:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:13767:x1876405526834560:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 1848us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480201.162334:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1789480201.242545:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480202.267510:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789480202.688808:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00010000:00010000:1.0:1789480203.290593:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480203.323644:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480203.323813:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834688 00000100:00100000:3.0:1789480203.323827:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834688 00000100:00100000:3.0:1789480203.323937:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789480203.323951:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:13819:x1876405526834688:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:3.0:1789480203.324013:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789480203.324177:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:13819:x1876405526834688:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 205us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480203.324187:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:1.0:1789480203.324333:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480203.328195:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480203.328342:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834816 00000100:00100000:0.0:1789480203.328356:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834816 00000100:00100000:0.0:1789480203.328468:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480203.328483:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:13819:x1876405526834816:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:0.0:1789480203.328541:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480203.328651:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:13819:x1876405526834816:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 172us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.328660:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00080000:1.0:1789480203.329325:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480203.336764:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480203.336945:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526834944 00000100:00100000:0.0:1789480203.336969:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526834944 00000100:00100000:0.0:1789480203.337060:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480203.337073:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13819:x1876405526834944:12345-192.168.204.54@tcp:13:lfs.0 00000100:00080000:1.0:1789480203.337302:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789480203.337394:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789480203.337519:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:13819:x1876405526834944:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 449us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.337528:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789480203.556449:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.556574:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835072 00000100:00100000:1.0:1789480203.556589:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835072 00000100:00100000:1.0:1789480203.556674:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1789480203.556687:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2185669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+10:13852:x1876405526835072:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789480203.556711:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480203.556736:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39c600/0xbb972366037fe857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f35b4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.556775:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39c600/0xbb972366037fe857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35b4 expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.556808:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39c600/0xbb972366037fe857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35b4 expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.556819:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c600, rc 0) 00000100:00100000:1.0:1789480203.556905:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2185669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835072:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 220us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.556912:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:3.0:1789480203.567919:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.568210:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835200 00000100:00100000:1.0:1789480203.568225:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835200 00000100:00100000:1.0:1789480203.568376:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:1.0:1789480203.568391:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835200:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480203.570923:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835200:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 2518us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.570943:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1789480203.584567:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480203.584660:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835328 00000100:00100000:2.0:1789480203.584675:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835328 00000100:00100000:2.0:1789480203.584747:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:2.0:1789480203.584759:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835328:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789480203.586940:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835328:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 2169us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480203.586955:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:2.0:1789480203.600859:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.601417:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835456 00000100:00100000:1.0:1789480203.601432:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835456 00000100:00100000:1.0:1789480203.601505:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:1.0:1789480203.601518:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13858:x1876405526835456:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480203.601995:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13858:x1876405526835456:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 477us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.602005:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1789480203.629265:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.631357:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835584 00000100:00100000:1.0:1789480203.631389:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835584 00000100:00100000:1.0:1789480203.631496:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1789480203.631511:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13858:x1876405526835584:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480203.631945:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13858:x1876405526835584:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 436us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.631955:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:2.0:1789480203.646404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480203.646805:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835712 00000100:00100000:3.0:1789480203.646821:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835712 00000100:00100000:3.0:1789480203.646909:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:3.0:1789480203.646923:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13852:x1876405526835712:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789480203.646949:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480203.646981:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f35de expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480203.647019:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35de expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480203.647032:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e4800/0xbb972366037fe85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35de expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480203.647042:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4800, rc 0) 00000100:00100000:3.0:1789480203.647235:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13852:x1876405526835712:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 314us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480203.647244:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:0.0:1789480203.655641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480203.655999:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835840 00000100:00100000:3.0:1789480203.656014:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835840 00000100:00100000:3.0:1789480203.656094:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:3.0:1789480203.656248:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13852:x1876405526835840:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789480203.657098:0:14318:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789480203.657151:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789480203.657157:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789480203.657161:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789480203.657164:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789480203.662444:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13852:x1876405526835840:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 6318us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480203.662477:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:2.0:1789480203.668190:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.669170:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526835968 00000100:00100000:1.0:1789480203.669187:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526835968 00000100:00100000:1.0:1789480203.669614:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1789480203.669630:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13852:x1876405526835968:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789480203.669655:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480203.669683:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f35e5 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.669726:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.669740:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 13 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480203.669752:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39de00, rc 0) 00000100:00100000:1.0:1789480203.669845:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13852:x1876405526835968:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 219us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.669853:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:0.0:1789480203.673000:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480203.673146:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836096 00000100:00100000:3.0:1789480203.673161:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836096 00000100:00100000:3.0:1789480203.673251:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:3.0:1789480203.673264:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13852:x1876405526836096:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789480203.673967:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13852:x1876405526836096:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 703us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480203.673978:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1789480203.682817:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.685031:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836224 00000100:00100000:1.0:1789480203.685054:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836224 00000100:00100000:1.0:1789480203.686084:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:1.0:1789480203.686574:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13852:x1876405526836224:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789480203.687786:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13852:x1876405526836224:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 1679us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.687817:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1789480203.695127:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.695385:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836352 00000100:00100000:1.0:1789480203.695401:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836352 00000100:00100000:1.0:1789480203.695493:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1789480203.695507:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13862:x1876405526836352:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480203.695939:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13862:x1876405526836352:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 434us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.695949:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:0.0:1789480203.712658:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480203.713412:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836480 00000100:00100000:1.0:1789480203.713428:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836480 00000100:00100000:1.0:1789480203.713515:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1789480203.713529:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13862:x1876405526836480:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480203.713876:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13862:x1876405526836480:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 349us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.713886:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:2.0:1789480203.728873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480203.729036:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836608 00000100:00100000:0.0:1789480203.729050:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836608 00000100:00100000:0.0:1789480203.729127:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789480203.729140:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1876405526836608:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789480203.729207:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 32666111-a0c9-493f-9593-5072557145d9@192.168.204.54@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1789480203.729272:0:14327:0:(genops.c:1384:class_connect()) connect: client 32666111-a0c9-493f-9593-5072557145d9, cookie 0xbb972366037fe86c 00000004:00100000:0.0:1789480203.729864:0:14327:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789480203.730076:0:14327:0:(import.c:65:import_set_state_nolock()) ffff8d22aea57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480203.730464:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2344:x1876405526836608:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 1322us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.730478:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1789480203.752413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480203.752459:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480203.752621:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836736 00000100:00100000:0.0:1789480203.752634:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836736 00000100:00100000:0.0:1789480203.752753:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836864 00000100:00100000:0.0:1789480203.752757:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836864 00000100:00100000:0.0:1789480203.752779:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480203.752791:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+7:0:x1876405526836736:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789480203.752833:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789480203.752940:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+7:0:x1876405526836736:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 151us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.752947:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1789480203.752969:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480203.752976:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526836864:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789480203.752988:0:14326:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789480203.753010:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526836864:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.753017:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:1.0:1789480203.753132:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480203.768600:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480203.769172:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526836992 00000100:00100000:3.0:1789480203.769188:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526836992 00000100:00100000:3.0:1789480203.769351:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789480203.769372:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526836992:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789480203.769567:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526836992:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 204us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480203.769578:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789480203.779160:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480203.779910:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837120 00000100:00100000:2.0:1789480203.779924:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837120 00000100:00100000:2.0:1789480203.779988:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789480203.779998:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1876405526837120:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789480203.780041:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 32666111-a0c9-493f-9593-5072557145d9@192.168.204.54@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1789480203.780085:0:15011:0:(genops.c:1384:class_connect()) connect: client 32666111-a0c9-493f-9593-5072557145d9, cookie 0xbb972366037fe873 00002000:00100000:2.0:1789480203.780100:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 32666111-a0c9-493f-9593-5072557145d9/ffff8d2187016800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789480203.780116:0:15011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789480203.780537:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789480203.780581:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8d2187013800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480203.780666:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32666111-a0c9-493f-9593-5072557145d9+6:2344:x1876405526837120:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 668us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480203.780675:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1789480203.784904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480203.785185:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837248 00000100:00100000:0.0:1789480203.785199:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837248 00000100:00100000:0.0:1789480203.785335:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480203.785347:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1876405526837248:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789480203.785608:0:15012:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 32666111-a0c9-493f-9593-5072557145d9@192.168.204.54@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1789480203.785651:0:15012:0:(genops.c:1384:class_connect()) connect: client 32666111-a0c9-493f-9593-5072557145d9, cookie 0xbb972366037fe87a 00002000:00100000:0.0:1789480203.785666:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 32666111-a0c9-493f-9593-5072557145d9/ffff8d22bb0dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789480203.785682:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789480203.785841:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789480203.785885:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8d22bb0dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480203.786049:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+6:2344:x1876405526837248:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 701us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480203.786057:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480203.809123:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480203.809512:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837376 00000100:00100000:2.0:1789480203.809527:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837376 00000100:00100000:2.0:1789480203.809604:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1789480203.809617:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526837376:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789480203.809732:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789480203.809858:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+6:13852:x1876405526837376:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 243us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480203.809867:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789480204.182678:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480204.182999:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837504 00000100:00100000:2.0:1789480204.183014:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837504 00000100:00100000:2.0:1789480204.183104:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789480204.183117:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:13883:x1876405526837504:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:2.0:1789480204.183149:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480204.183185:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fe881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f360f expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183327:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183343:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183362:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480204.183410:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480204.183413:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480204.183439:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183492:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fe881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183515:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 7 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480204.183524:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480204.183527:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480204.183532:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187647800, rc 0) 00000100:00100000:2.0:1789480204.185277:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+7:13883:x1876405526837504:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 2148us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480204.185317:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:0.0:1789480204.314667:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480204.634685:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551998720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.634791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480204.634886:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480204.634893:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551998592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.634924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480204.635226:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551998464:0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.635275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480204.635346:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551998976:0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.635381:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480204.635404:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789480204.635410:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551998336:0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.635445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480204.635467:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551998848:0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.635490:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480204.635526:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998720 00000100:00100000:0.0:1789480204.635537:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998720 00000100:00100000:0.0:1789480204.635589:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998976 00000100:00100000:0.0:1789480204.635610:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998976 00000100:00100000:0.0:1789480204.635643:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998848 00000100:00100000:0.0:1789480204.635646:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998848 00000100:00100000:0.0:1789480204.635667:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789480204.635677:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551998720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.635740:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876405551998720:12345-0@lo:400:kworker.0 Request processed in 64us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480204.635975:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789480204.636000:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789480204.636008:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.636049:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876405551998976:12345-0@lo:400:kworker.0 Request processed in 42us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480204.636056:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789480204.636068:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789480204.636075:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551998848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.636104:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876405551998848:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480204.636109:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789480204.636131:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480204.636169:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876405551998848:0@lo:400:kworker.0 00000100:00100000:0.0:1789480204.636183:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876405551998976:0@lo:400:kworker.0 00000100:00100000:2.0:1789480204.636357:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998592 00000100:00100000:2.0:1789480204.636363:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998592 00000100:00100000:2.0:1789480204.636418:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998464 00000100:00100000:2.0:1789480204.636421:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998464 00000100:00100000:2.0:1789480204.636448:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480204.636455:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551998592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480204.636497:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551998592:12345-0@lo:400:kworker.0 Request processed in 42us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480204.636503:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480204.636518:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480204.636524:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551998464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480204.636556:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405551998464:12345-0@lo:400:kworker.0 Request processed in 33us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480204.636562:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789480204.636593:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480204.636597:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480204.636726:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405551998464:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.637279:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551998336 00000100:00100000:3.0:1789480204.637320:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551998336 00000100:00100000:3.0:1789480204.637356:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789480204.637373:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3299:x1876405551998336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.637438:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3299:x1876405551998336:12345-0@lo:400:kworker.0 Request processed in 75us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480204.637446:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789480204.637510:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551998592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.637527:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876405551998720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.637543:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480204.637553:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551999104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480204.637584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480204.637625:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999104 00000100:00100000:3.0:1789480204.637629:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999104 00000100:00100000:3.0:1789480204.637652:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789480204.637658:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551999104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480204.637676:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480204.637715:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405551999104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480204.637722:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480204.638043:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3299:1876405551998336:0@lo:400:kworker.0 00000100:00100000:3.0:1789480204.638156:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405551999104:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789480205.283830:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000001:00100000:0.0:1789480205.283852:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00010000:00010000:3.0:1789480205.352221:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480205.662162:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480205.662199:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551999232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480205.662493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480205.662564:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999232 00000100:00100000:3.0:1789480205.662572:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999232 00000100:00100000:3.0:1789480205.662684:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480205.662694:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551999232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480205.662740:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480205.662792:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551999232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480205.662800:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480205.663986:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551999232:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789480206.310246:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000001:00100000:0.0:1789480206.310312:0:5852:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11a5fd0e-73e8-4c23-8b68-dd708fa09a05 00010000:00010000:3.0:1789480206.368949:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480207.396350:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789480207.801127:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32666111-a0c9-493f-9593-5072557145d9 00000040:00080000:2.0:1789480207.901555:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789480208.411695:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480208.440152:0:16294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789480209.278451:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278500:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278539:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278559:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278579:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278602:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278629:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480209.278666:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838144 00000100:00100000:0.0:1789480209.278680:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838144 00000100:00100000:0.0:1789480209.278749:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837760 00000100:00100000:0.0:1789480209.278752:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837760 00000100:00100000:0.0:1789480209.278775:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789480209.278802:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526838144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.278904:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526838144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.278912:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1789480209.278933:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480209.278940:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526837760:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.278966:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526837760:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.278972:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480209.278993:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837888 00000100:00100000:0.0:1789480209.278996:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837888 00000100:00100000:0.0:1789480209.279018:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838400 00000100:00100000:0.0:1789480209.279021:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838400 00000100:00100000:0.0:1789480209.279058:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838016 00000100:00100000:0.0:1789480209.279061:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838016 00000100:00100000:0.0:1789480209.279074:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838272 00000100:00100000:0.0:1789480209.279076:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838272 00000100:00100000:0.0:1789480209.279091:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480209.279097:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2347:x1876405526837888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.279128:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2347:x1876405526837888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.279135:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1789480209.279146:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480209.279153:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+5:2347:x1876405526838400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.279176:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+5:2347:x1876405526838400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.279183:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1789480209.279194:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480209.279216:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2347:x1876405526838016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.279240:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2347:x1876405526838016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.279245:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480209.279257:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1789480209.279264:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+5:2347:x1876405526838272:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480209.279318:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+5:2347:x1876405526838272:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 54us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.279324:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789480209.279559:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526837632 00000100:00100000:3.0:1789480209.279565:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526837632 00000100:00100000:3.0:1789480209.279604:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:3.0:1789480209.279611:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2347:x1876405526837632:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480209.279642:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2347:x1876405526837632:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.279649:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00080000:2.0:1789480209.279765:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480209.279771:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480209.279787:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480209.436428:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480209.757107:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551999360:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757200:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757268:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551999872:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757319:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757347:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789480209.757354:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551999488:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757410:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552000000:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757441:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757469:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551999616:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757513:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480209.757519:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551999744:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757569:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999872 00000100:00100000:3.0:1789480209.757591:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999872 00000100:00100000:3.0:1789480209.757639:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000000 00000100:00100000:3.0:1789480209.757643:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000000 00000100:00100000:3.0:1789480209.757655:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999744 00000100:00100000:3.0:1789480209.757657:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999744 00000100:00100000:3.0:1789480209.757671:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789480209.757679:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551999872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480209.757693:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480209.757712:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552000128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480209.757729:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876405551999872:12345-0@lo:400:kworker.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.757735:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480209.757737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.757752:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480209.757759:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552000000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757786:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552000000:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.757791:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480209.757795:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999488 00000100:00100000:2.0:1789480209.757799:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999488 00000100:00100000:3.0:1789480209.757802:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480209.757806:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551999744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480209.757826:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999616 00000100:00100000:2.0:1789480209.757829:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999616 00000100:00100000:3.0:1789480209.757831:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405551999744:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.757835:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789480209.757849:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789480209.757854:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551999488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757866:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405551999744:0@lo:400:kworker.0 00000100:00100000:2.0:1789480209.757882:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405551999488:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.757887:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480209.757889:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405551999488:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757897:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552000000:0@lo:400:kworker.0 00000100:00100000:2.0:1789480209.757898:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789480209.757904:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551999616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757905:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876405551999872:0@lo:400:kworker.0 00000100:00100000:3.0:1789480209.757923:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000128 00000100:00100000:3.0:1789480209.757932:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000128 00000100:00100000:2.0:1789480209.757932:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405551999616:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.757937:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480209.757954:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480209.757959:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552000128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480209.757981:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405551999616:0@lo:400:kworker.0 00002000:00000024:3.0:1789480209.757986:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789480209.757994:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480209.758004:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480209.758006:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480209.758034:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552000128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.758041:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789480209.758062:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552000128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480209.758525:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405551999360 00000100:00100000:0.0:1789480209.758538:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405551999360 00000100:00100000:0.0:1789480209.758574:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789480209.758581:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3298:x1876405551999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.758636:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3298:x1876405551999360:12345-0@lo:400:kworker.0 Request processed in 55us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.758642:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789480209.758680:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405551999360:0@lo:400:kworker.0 00010000:00010000:0.0:1789480210.460456:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480210.783075:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552000256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480210.783160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480210.783256:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000256 00000100:00100000:1.0:1789480210.783264:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000256 00000100:00100000:1.0:1789480210.783335:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480210.783345:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552000256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480210.783395:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789480210.783615:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552000256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 271us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480210.783623:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480210.783793:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552000256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480211.485257:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480212.509502:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789480213.423784:0:16444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfb522ad0 20000000:00000080:3.0:1789480213.423802:0:16444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2186a5d400 uarg=0000000000000000 20000000:01000000:3.0:1789480213.423841:0:16444:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789480213.423847:0:16444:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789480213.423851:0:16444:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789480213.429356:0:16445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789480213.433094:0:16444:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789480213.445681:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789480213.450885:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.450911:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe57f expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451420:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe5cc expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451427:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451436:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451444:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451453:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451504:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451536:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 12 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.451552:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000384:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480213.451666:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451675:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 12 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.451684:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000512:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480213.451859:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451867:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.451877:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000640:0@lo:104: 00000100:00100000:0.0:1789480213.451928:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789480213.451969:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 18 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.451976:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 18 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.451984:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000768:0@lo:104: 00000100:00100000:0.0:1789480213.452005:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789480213.452097:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480213.452105:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 18 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.452114:0:16444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000896:0@lo:104: 00000100:00100000:0.0:1789480213.452152:0:16444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480213.466542:0:16444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2186521540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480213.468613:0:14309:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789480213.468644:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000640 00000100:00100000:3.0:1789480213.468654:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000640 00000100:00100000:3.0:1789480213.468704:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000768 00000100:00100000:3.0:1789480213.468707:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000768 00000100:00100000:3.0:1789480213.468715:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552000896 00000100:00100000:3.0:1789480213.468718:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552000896 00000100:00100000:3.0:1789480213.468732:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480213.468741:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:16444:x1876405552000640:12345-0@lo:104: 00010000:00010000:3.0:1789480213.468758:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.468936:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789480213.468943:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+5:16444:x1876405552000640:12345-0@lo:104: Request processed in 204us (17016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.468952:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480213.468987:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480213.468993:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+4:16444:x1876405552000768:12345-0@lo:104: 00010000:00010000:3.0:1789480213.469002:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469039:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789480213.469045:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+4:16444:x1876405552000768:12345-0@lo:104: Request processed in 53us (17039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.469050:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480213.469062:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480213.469068:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba790450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:16444:x1876405552000896:12345-0@lo:104: 00010000:00010000:3.0:1789480213.469076:0:14309:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469102:0:14309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789480213.469108:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba790450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+3:16444:x1876405552000896:12345-0@lo:104: Request processed in 41us (16955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.469113:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480213.469237:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480213.469338:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1789480213.469357:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789480213.469364:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469373:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480213.469377:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469397:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480213.469404:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480213.469409:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480213.469443:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469450:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480213.469469:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469476:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c000/0xbb972366037fe700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe707 expref: -99 pid: 15727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469489:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480213.469492:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469499:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d000 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480213.469502:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469510:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480213.469516:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480213.469527:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480213.469541:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469547:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480213.469553:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469559:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb39d000/0xbb972366037fe5cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe5d3 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469567:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480213.469570:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469575:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1af9c20) 10000000:00010000:3.0:1789480213.469578:0:14315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469585:0:14315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480213.469591:0:14315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480213.469596:0:14315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480213.469607:0:14315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469611:0:14315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480213.469629:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469635:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8d22bb0e6200/0xbb972366037fe57f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb972366037fe586 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469646:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480213.469648:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480213.469650:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480213.469661:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838528 00000100:00100000:3.0:1789480213.469665:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838528 00010000:00010000:3.0:1789480213.469762:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 13 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480213.469780:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838656 00000100:00100000:3.0:1789480213.469783:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838656 00010000:00010000:3.0:1789480213.469793:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 14 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480213.469803:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480213.469809:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+14:2348:x1876405526838528:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480213.469818:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480213.469822:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 14 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469833:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 14 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469847:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480213.469886:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+14:2348:x1876405526838528:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 76us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.469901:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480213.469915:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789480213.469920:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2348:x1876405526838656:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480213.469926:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480213.469931:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 13 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469939:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 13 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.469953:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480213.469969:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2348:x1876405526838656:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 50us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.469975:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00010000:00010000:1.0:1789480213.471166:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480213.471200:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552001024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480213.471272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480213.471341:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480213.471347:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552001152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480213.471370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480213.471388:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552001280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480213.471408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480213.471433:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001024 00000100:00100000:1.0:1789480213.471439:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001024 00010000:00010000:1.0:1789480213.471465:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 19 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480213.471485:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001152 00000100:00100000:1.0:1789480213.471487:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001152 00010000:00010000:1.0:1789480213.471496:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 20 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480213.471525:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001280 00000100:00100000:1.0:1789480213.471528:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001280 00010000:00010000:1.0:1789480213.471538:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 21 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480213.471551:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480213.471557:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4b57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+21:3298:x1876405552001024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480213.471568:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480213.471572:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 21 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471584:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 21 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471614:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480213.471647:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4b57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+21:3298:x1876405552001024:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480213.471653:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480213.471691:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480213.471696:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+20:3298:x1876405552001152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480213.471703:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480213.471707:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 20 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471716:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 20 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471726:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480213.471752:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+20:3298:x1876405552001152:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480213.471759:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480213.471770:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480213.471776:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3300:x1876405552001280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480213.471782:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480213.471786:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 19 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471795:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 19 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471808:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471817:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471832:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471839:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471846:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471853:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471860:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6800 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480213.471870:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471878:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471888:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480213.471898:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480213.471940:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3300:x1876405552001280:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480213.471947:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480213.471980:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3300:1876405552001280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480213.472001:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552001152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480213.472008:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3298:1876405552001024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480213.472506:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1789480213.473771:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe700 expref: 18 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480213.473791:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000640:0@lo:104: 00010000:00010000:2.0:1789480213.473884:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e4400/0xbb972366037fe5d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe5cc expref: 17 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480213.473894:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000768:0@lo:104: 00010000:00010000:2.0:1789480213.473904:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb972366037fe57f expref: 16 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480213.475074:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000896:0@lo:104: 00010000:00010000:2.0:1789480213.475106:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb39de00/0xbb972366037fe865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35e5 expref: 12 pid: 14320 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480213.475132:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000384:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480213.475143:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22a48e5c00/0xbb972366037fe82d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3583 expref: 11 pid: 14318 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480213.475151:0:16444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1876405552000512:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480213.475184:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480213.475194:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480213.475201:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480213.475229:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe88f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480213.549725:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480214.388252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480214.388366:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480214.388374:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838784 00000100:00100000:0.0:1789480214.388390:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838784 00000100:00100000:1.0:1789480214.388396:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480214.388428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480214.388462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480214.388478:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1789480214.388506:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480214.388506:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:2346:x1876405526838784:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480214.388521:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839296 00000100:00100000:3.0:1789480214.388528:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839296 00000100:00100000:1.0:1789480214.388541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480214.388596:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839040 00000100:00100000:3.0:1789480214.388604:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526838912 00000100:00100000:1.0:1789480214.388606:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839040 00000100:00100000:3.0:1789480214.388610:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526838912 00000100:00100000:0.0:1789480214.388619:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:2346:x1876405526838784:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 127us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.388630:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:3.0:1789480214.388637:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480214.388652:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2346:x1876405526839296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480214.388689:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839552 00000100:00100000:1.0:1789480214.388696:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839552 00000100:00100000:3.0:1789480214.388702:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+6:2346:x1876405526839296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.388713:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1789480214.388723:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839168 00000100:00100000:0.0:1789480214.388732:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839168 00000100:00100000:1.0:1789480214.388733:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839424 00000100:00100000:3.0:1789480214.388742:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1789480214.388752:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2346:x1876405526838912:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480214.388761:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839424 00000100:00100000:0.0:1789480214.388770:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1789480214.388790:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2346:x1876405526839040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480214.388819:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2346:x1876405526838912:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 58us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480214.388821:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1789480214.388837:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1789480214.388838:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2346:x1876405526839040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.388862:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789480214.388864:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32666111-a0c9-493f-9593-5072557145d9+5:2346:x1876405526839552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:3.0:1789480214.388865:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480214.388880:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480214.388884:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480214.388899:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480214.388920:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2346:x1876405526839168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480214.388964:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2346:x1876405526839168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 48us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.388972:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480214.388994:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1789480214.389002:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32666111-a0c9-493f-9593-5072557145d9+5:2346:x1876405526839424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480214.389032:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32666111-a0c9-493f-9593-5072557145d9+5:2346:x1876405526839424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.389039:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1789480214.389177:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32666111-a0c9-493f-9593-5072557145d9+5:2346:x1876405526839552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 334us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480214.389187:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 10000000:01000000:1.0:1789480214.490417:0:14324:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480214.490425:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d22bb597000 from 10 10000000:01000000:1.0:1789480214.490431:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480214.490480:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.490492:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.490503:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.490528:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.490606:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.490682:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480214.490936:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001408 00000100:00100000:3.0:1789480214.490944:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001408 00000100:00100000:3.0:1789480214.490999:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789480214.491008:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+16:14324:x1876405552001408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480214.491020:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480214.491034:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fe89d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe896 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480214.491055:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fe89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe896 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480214.491067:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22a48e5a00/0xbb972366037fe89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe896 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480214.491075:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5a00, rc 0) 00000100:00100000:3.0:1789480214.491133:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.491140:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789480214.491385:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480214.491400:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.491409:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.491465:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.491510:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.491542:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480214.497364:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001536 00000100:00100000:0.0:1789480214.497389:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001536 00000100:00100000:2.0:1789480214.503679:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789480214.503712:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480214.504164:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 468us (12652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480214.504174:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789480214.507267:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.507404:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.507513:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.509352:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480214.509430:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001664 00000100:00100000:3.0:1789480214.509441:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001664 00000100:00100000:2.0:1789480214.509531:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789480214.509546:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480214.509908:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480214.509917:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789480214.510026:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480214.511039:0:16457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789480214.511213:0:14324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789480214.511230:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480214.511240:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.511250:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39ca00/0xbb972366037fe896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe89d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480214.511259:0:14324:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480214.511261:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2286ffc000 from 10 10000000:01000000:1.0:1789480214.511263:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480214.511320:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.511327:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.511336:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.511361:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.511442:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.511522:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480214.511556:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001792 00000100:00100000:0.0:1789480214.511563:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001792 00000100:00100000:0.0:1789480214.511648:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789480214.511658:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+17:14324:x1876405552001792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480214.511672:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480214.511686:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe8ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe8a4 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.511713:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe8a4 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.511725:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6a00/0xbb972366037fe8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe8a4 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.511735:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6a00, rc 0) 00000100:00100000:0.0:1789480214.511784:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552001792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.511798:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789480214.511875:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480214.511889:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.511899:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.511959:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.511991:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.512014:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480214.512149:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552001920 00000100:00100000:0.0:1789480214.512154:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552001920 00000100:00100000:0.0:1789480214.512182:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789480214.512188:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552001920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480214.512523:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552001920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.512530:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789480214.512552:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552001920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.512582:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.512622:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.512653:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480214.512701:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002048 00000100:00100000:2.0:1789480214.512706:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002048 00000100:00100000:2.0:1789480214.512783:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789480214.512792:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552002048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480214.512970:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552002048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480214.512978:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789480214.513047:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480214.513824:0:16458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789480214.513979:0:14324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789480214.513994:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480214.514004:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.514013:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39c200/0xbb972366037fe8a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8ab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480214.514022:0:14324:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480214.514031:0:14324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2187178000 from 10 10000000:01000000:1.0:1789480214.514034:0:14324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480214.514062:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.514068:0:14324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.514076:0:14324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.514089:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.514138:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.514208:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480214.514240:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002176 00000100:00100000:0.0:1789480214.514245:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002176 00000100:00100000:0.0:1789480214.514370:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789480214.514377:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22baecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+18:14324:x1876405552002176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480214.514388:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480214.514399:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe8b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb972366037fe8b2 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.514419:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe8b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb972366037fe8b2 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.514427:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb0e6800/0xbb972366037fe8b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb972366037fe8b2 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480214.514435:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6800, rc 0) 00000100:00100000:0.0:1789480214.514461:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22baecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405552002176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.514466:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789480214.515139:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480214.515159:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.515170:0:14324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480214.515237:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.515274:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.516206:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480214.516264:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002304 00000100:00100000:3.0:1789480214.516272:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002304 00000100:00100000:0.0:1789480214.516359:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789480214.516387:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405552002304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480214.516760:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405552002304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480214.516768:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789480214.516936:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.516992:0:14324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.517043:0:14324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480214.519045:0:14324:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229249a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480214.520023:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002432 00000100:00100000:0.0:1789480214.520134:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002432 00000100:00100000:1.0:1789480214.520377:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789480214.520390:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405552002432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480214.520779:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:14324:x1876405552002432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 391us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480214.520789:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789480214.521008:0:14324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bd7e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:14324:1876405552002432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480214.523868:0:16459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789480214.524243:0:14324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789480214.524384:0:14324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480214.524398:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480214.524409:0:14324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8d22bb39de00/0xbb972366037fe8b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb972366037fe8b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480214.554497:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480214.874522:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552002944:0@lo:400:kworker.0 00000100:00100000:0.0:1789480214.874540:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552002688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.874738:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552002560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480214.874935:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552002816:0@lo:400:kworker.0 00000100:00100000:2.0:1789480214.878693:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480214.879028:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002944 00000100:00100000:2.0:1789480214.879040:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002944 00000100:00100000:2.0:1789480214.879114:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480214.879127:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552002944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480214.879204:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876405552002944:12345-0@lo:400:kworker.0 Request processed in 80us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480214.879213:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789480214.879274:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876405552002944:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.881554:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.881629:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552003072:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.881667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.881722:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002560 00000100:00100000:3.0:1789480214.881731:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002560 00000100:00100000:3.0:1789480214.881793:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480214.881802:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552002560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480214.881847:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480214.881897:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552002560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.881904:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480214.882987:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003072 00000100:00100000:3.0:1789480214.882998:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003072 00000100:00100000:3.0:1789480214.883047:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480214.883056:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.883532:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552003072:12345-0@lo:400:kworker.0 Request processed in 476us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.883540:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789480214.883564:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480214.883584:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480214.883653:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552002560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480214.883669:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552003072:0@lo:400:kworker.0 00000100:00100000:1.0:1789480214.884218:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.884478:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002816 00000100:00100000:3.0:1789480214.884486:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002816 00000100:00100000:3.0:1789480214.884535:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789480214.884545:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552002816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480214.884603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.884613:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876405552002816:12345-0@lo:400:kworker.0 Request processed in 69us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.884621:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789480214.884640:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552002688 00000100:00100000:3.0:1789480214.884644:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552002688 00000100:00100000:0.0:1789480214.884653:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552003200:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.884681:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480214.884688:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552002688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.884720:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552002688:12345-0@lo:400:kworker.0 Request processed in 32us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.884725:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789480214.884741:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480214.884882:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876405552002816:0@lo:400:kworker.0 00000100:00100000:0.0:1789480214.884965:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480214.885008:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552002688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.885472:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003200 00000100:00100000:3.0:1789480214.885477:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003200 00000100:00100000:3.0:1789480214.885562:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789480214.885572:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552003200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.885626:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876405552003200:12345-0@lo:400:kworker.0 Request processed in 57us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.885633:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789480214.885680:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876405552003200:0@lo:400:kworker.0 00000100:00080000:1.0:1789480214.888651:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480215.024916:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480215.027848:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839680 00000100:00100000:2.0:1789480215.027871:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839680 00000100:00100000:2.0:1789480215.027964:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:2.0:1789480215.027978:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+11:13734:x1876405526839680:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480215.028002:0:14320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480215.028029:0:14320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2187646200/0xbb972366037fe8c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3616 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480215.028069:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2187646200/0xbb972366037fe8c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3616 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480215.028083:0:14320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2187646200/0xbb972366037fe8c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3616 expref: 12 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480215.028104:0:14320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646200, rc 0) 00000100:00100000:2.0:1789480215.028195:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526839680:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 219us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480215.028202:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1789480215.046801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480215.046936:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839808 00000100:00100000:1.0:1789480215.046950:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839808 00000100:00100000:1.0:1789480215.047028:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789480215.047040:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526839808:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480215.047463:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526839808:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 424us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480215.047473:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1789480215.053068:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480215.053957:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526839936 00000100:00100000:0.0:1789480215.053971:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526839936 00000100:00100000:0.0:1789480215.054046:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1789480215.054059:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526839936:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480215.054446:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526839936:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 389us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480215.054457:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:3.0:1789480215.061125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480215.062500:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840064 00000100:00100000:1.0:1789480215.062517:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840064 00000100:00100000:1.0:1789480215.062599:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1789480215.062611:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+12:13734:x1876405526840064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480215.062631:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480215.062655:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe8c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a0812db605f361d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480215.062725:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe8c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f361d expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480215.062738:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d22bb39c800/0xbb972366037fe8c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f361d expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480215.062750:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c800, rc 0) 00000100:00100000:1.0:1789480215.062826:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13734:x1876405526840064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 217us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480215.062835:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1789480215.069676:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480215.069988:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840192 00000100:00100000:0.0:1789480215.070002:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840192 00000100:00100000:0.0:1789480215.070066:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1789480215.070078:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13734:x1876405526840192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480215.070945:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13734:x1876405526840192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 865us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480215.070962:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1789480215.074326:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480215.074465:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840320 00000100:00100000:2.0:1789480215.074479:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840320 00000100:00100000:2.0:1789480215.074548:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:2.0:1789480215.074558:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13734:x1876405526840320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480215.074970:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:13734:x1876405526840320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 412us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480215.074979:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00010000:00010000:3.0:1789480215.585367:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480215.900681:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480215.900712:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552003328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480215.900800:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480215.901115:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003328 00000100:00100000:2.0:1789480215.901126:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003328 00000100:00100000:2.0:1789480215.901192:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480215.901203:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552003328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480215.901508:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480215.901566:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552003328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 365us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480215.901573:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480215.902211:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552003328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480216.612770:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480217.115711:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789480217.629877:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480218.647509:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480218.647712:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840448 00000100:00100000:3.0:1789480218.647725:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840448 00000100:00100000:3.0:1789480218.647836:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789480218.647852:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:14394:x1876405526840448:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480218.647881:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480218.647922:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3624 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648022:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648041:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648060:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648077:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648086:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648093:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648556:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648567:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648575:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480218.648911:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480218.648917:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480218.648966:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648980:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648988:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.648995:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649002:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.649007:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649025:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649041:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480218.649053:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.649061:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649068:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649083:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649090:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649264:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649270:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.649273:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649340:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649351:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d22837b7300) 00010000:00010000:3.0:1789480218.649354:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.649357:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.649363:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789480218.650215:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480218.650275:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3624 expref: 8 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.650349:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4c00/0xbb972366037fe8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3624 expref: 7 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.650357:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d22837b7800) 00010000:00010000:3.0:1789480218.650360:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480218.650364:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4c00, rc 0) 00000100:00100000:3.0:1789480218.651034:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:14394:x1876405526840448:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3184us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480218.651046:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:3.0:1789480218.653646:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480218.656201:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480218.656565:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840704 00000100:00100000:3.0:1789480218.656579:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840704 00000100:00100000:3.0:1789480218.656663:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480218.656676:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:14394:x1876405526840704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480218.656705:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480218.656731:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f362b expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.657066:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.657083:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.657564:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.657991:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.658003:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.658011:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.666227:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.666260:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.666277:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480218.667898:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789480218.668917:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.668929:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.668939:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.668945:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.668951:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.668973:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.668993:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d22837b7800) 00010000:00010000:3.0:1789480218.668996:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.669002:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669007:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe8f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669033:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669039:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669044:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669050:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.669053:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669059:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669065:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d22837b7300) 00010000:00010000:3.0:1789480218.669068:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.669070:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.669086:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe8f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.675585:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe8ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f362b expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.675836:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5800/0xbb972366037fe8ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f362b expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.675846:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d22837b7900) 00010000:00010000:3.0:1789480218.675850:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.675855:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5800, rc 0) 00000100:00100000:3.0:1789480218.675967:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14394:x1876405526840704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 19291us (19776us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789480218.675976:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480218.693992:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480218.694355:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840832 00000100:00100000:3.0:1789480218.694369:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840832 00000100:00100000:3.0:1789480218.694447:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789480218.694461:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14394:x1876405526840832:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789480218.694619:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14394:x1876405526840832:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 161us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480218.694628:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1789480218.769470:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480218.769983:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526840960 00000100:00100000:3.0:1789480218.770001:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526840960 00000100:00100000:3.0:1789480218.770090:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789480218.770206:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14400:x1876405526840960:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480218.770258:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480218.770353:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe90d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3632 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770442:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770461:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770476:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770495:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770503:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770511:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770799:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770808:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770815:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770822:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.770833:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770843:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770859:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480218.770862:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.770869:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770876:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770890:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.770896:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773367:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773379:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e5000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.773385:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773397:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773418:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d22837b7300) 00010000:00010000:3.0:1789480218.773420:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.773449:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773457:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe91b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.773540:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe90d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3632 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.774969:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480218.774973:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.774982:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3632 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.774999:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e4000, rc 0) 00000100:00100000:3.0:1789480218.776000:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14400:x1876405526840960:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 5791us (6538us total) trans 0 rc 301/301 00000100:00100000:3.0:1789480218.787335:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1789480218.790842:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480218.791026:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841088 00000100:00100000:1.0:1789480218.791039:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841088 00000100:00100000:1.0:1789480218.791113:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480218.791125:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14400:x1876405526841088:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:1.0:1789480218.791244:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14400:x1876405526841088:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 121us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480218.791253:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789480218.798219:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480218.798492:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841344 00000100:00100000:2.0:1789480218.798506:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841344 00000100:00100000:2.0:1789480218.798721:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1789480218.798738:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14400:x1876405526841344:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1789480218.798826:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480218.798864:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037fe850 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f35ad expref: 9 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480218.798924:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:2.0:1789480218.798931:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480218.800834:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480218.800867:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 5 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480218.800878:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480218.800933:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 5 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480218.800956:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 5 pid: 14327 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480218.800973:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14326:1876405552003456:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480218.801215:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545180 going to sleep for 11 seconds 00000100:00100000:2.0:1789480218.828489:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480218.828585:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841472 00000100:00100000:1.0:1789480218.828598:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841472 00010000:00010000:1.0:1789480218.828680:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 6 pid: 14327 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480218.828726:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1789480218.828738:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526841472:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480218.828777:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480218.828785:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 6 pid: 14327 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480218.828803:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 6 pid: 14327 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480218.828830:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:1.0:1789480218.828836:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480218.828848:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480218.828856:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480218.828882:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480218.828961:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526841472:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 224us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480218.828970:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:2.0:1789480218.829249:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480218.829972:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fe888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f360f expref: 5 pid: 14327 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480218.829999:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14326:1876405552003456:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480218.830037:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.830047:0:14326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.830054:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.830222:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.830239:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.830249:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480218.831964:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789480218.831984:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.831996:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.832005:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.832025:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.832031:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.832041:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.832061:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2290ce3100) 00010000:00010000:3.0:1789480218.832064:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.832070:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.832090:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fe922 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480218.832117:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4368d35 reply state 0000000081f60fd0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480218.832129:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480218.832266:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+10:14400:x1876405526841344:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 33526us (34056us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789480218.832276:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:3.0:1789480218.847913:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.847937:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.847947:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.847953:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22a48e4000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480218.847959:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.847968:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.847989:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d22837b7300) 00010000:00010000:3.0:1789480218.847993:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480218.847999:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480218.848041:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe929 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480219.022137:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.022327:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841600 00000100:00100000:3.0:1789480219.022341:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841600 00000100:00100000:3.0:1789480219.022420:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480219.022432:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:14408:x1876405526841600:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:3.0:1789480219.022474:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480219.022502:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3639 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023044:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023063:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023090:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480219.023134:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480219.023138:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480219.023185:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023215:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3639 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023238:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5000/0xbb972366037fe937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3639 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.023265:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480219.023268:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480219.023272:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5000, rc 0) 00000100:00100000:3.0:1789480219.023408:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+10:14408:x1876405526841600:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 978us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.023416:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1789480219.066823:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.067056:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841728 00000100:00100000:3.0:1789480219.067070:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841728 00000100:00100000:3.0:1789480219.067151:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789480219.067163:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+5:14409:x1876405526841728:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480219.067191:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480219.067230:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe93e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3640 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067351:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067369:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067383:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480219.067429:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480219.067433:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480219.067458:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067508:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4000/0xbb972366037fe93e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3640 expref: 7 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067531:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e5c00/0xbb972366037fe945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3640 expref: 6 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.067541:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480219.067545:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480219.067666:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22a48e5c00, rc 0) 00000100:00100000:3.0:1789480219.067736:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+6:14409:x1876405526841728:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 575us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.067744:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1789480219.073110:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.073213:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526841856 00000100:00100000:3.0:1789480219.073226:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526841856 00000100:00100000:3.0:1789480219.073335:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1789480219.073348:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+6:14409:x1876405526841856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480219.073375:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480219.073401:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe94c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3647 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073492:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073510:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073522:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073569:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073578:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073586:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073696:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073705:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073712:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480219.073749:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789480219.073753:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480219.073774:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073788:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073795:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073802:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073818:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.073823:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073832:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073846:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480219.073849:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.073856:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073862:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073880:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073886:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073892:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073897:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d3800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.073900:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073907:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073924:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d22837b7000) 00010000:00010000:3.0:1789480219.073926:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.073929:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073935:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe95a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073975:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22a48e4400/0xbb972366037fe94c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3647 expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073990:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3647 expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.073998:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d22837b7c00) 00010000:00010000:3.0:1789480219.074000:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480219.074003:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2a00, rc 0) 00000100:00100000:3.0:1789480219.074092:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+7:14409:x1876405526841856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 747us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.074100:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1789480219.086803:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.086929:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526842112 00000100:00100000:0.0:1789480219.086943:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526842112 00000100:00100000:0.0:1789480219.087028:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1789480219.087042:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+7:14409:x1876405526842112:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1789480219.087078:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480219.087109:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f364e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480219.087235:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789480219.087444:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe968 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f364e expref: 9 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.087461:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:0.0:1789480219.087464:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480219.087470:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f364e expref: 9 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.087486:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480219.087576:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+8:14409:x1876405526842112:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 538us (789us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789480219.087601:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789480219.090677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.091002:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526842368 00000100:00100000:0.0:1789480219.091026:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526842368 00000100:00100000:0.0:1789480219.091116:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1789480219.091131:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+8:14409:x1876405526842368:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1789480219.091204:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480219.091251:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2a00/0xbb972366037fe961 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3647 expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.091273:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d22837b7c00) 00010000:00010000:0.0:1789480219.091308:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480219.091341:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.091358:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.091370:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480219.091674:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005323aa7a reply state 0000000067249c6d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480219.091686:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789480219.091696:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789480219.091815:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32666111-a0c9-493f-9593-5072557145d9+9:14409:x1876405526842368:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 687us (1151us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789480219.091822:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1789480219.096820:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.096940:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526842624 00000100:00100000:1.0:1789480219.096955:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526842624 00000100:00100000:1.0:1789480219.097037:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1789480219.097051:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+9:14409:x1876405526842624:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789480219.097446:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+10:14409:x1876405526842624:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 397us (640us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789480219.097454:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00010000:00010000:3.0:1789480219.098124:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098141:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098150:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098168:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.098174:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098184:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098205:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2290ce3e00) 00010000:00010000:3.0:1789480219.098209:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789480219.098215:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.098221:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037fe976 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480219.101383:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.101984:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526842880 00000100:00100000:3.0:1789480219.101998:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526842880 00000100:00100000:3.0:1789480219.102092:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1789480219.102105:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+9:14409:x1876405526842880:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480219.102140:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480219.102166:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe97d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3655 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102264:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102305:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102319:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102359:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102368:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102376:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480219.102514:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789480219.102791:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102801:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102807:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102814:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.102819:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102827:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102839:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480219.102842:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.102847:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102862:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037fe984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102880:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102886:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102892:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102897:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d3000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.102900:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102905:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102913:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d22837b7000) 00010000:00010000:3.0:1789480219.102916:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.102918:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102924:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fe98b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102975:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe97d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3655 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.102997:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:3.0:1789480219.103000:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480219.103015:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fe97d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3655 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.103027:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d3800, rc 0) 00000100:00100000:3.0:1789480219.103345:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+10:14409:x1876405526842880:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1242us (1975us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789480219.103355:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1789480219.107277:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.107442:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843008 00000100:00100000:2.0:1789480219.107454:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843008 00000100:00100000:2.0:1789480219.107568:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789480219.107579:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+10:14409:x1876405526843008:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480219.107640:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480219.107668:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe999 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f365c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107783:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107800:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107815:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.107844:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789480219.107847:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480219.107869:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107898:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe999 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 12 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107918:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.107926:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:2.0:1789480219.107929:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480219.107934:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187647e00, rc 0) 00000100:00100000:2.0:1789480219.108062:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32666111-a0c9-493f-9593-5072557145d9+11:14409:x1876405526843008:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 485us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480219.108193:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1789480219.113215:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.113384:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843136 00000100:00100000:1.0:1789480219.113397:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843136 00000100:00100000:1.0:1789480219.113462:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1789480219.113473:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+11:14409:x1876405526843136:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:2.0:1789480219.120402:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32666111-a0c9-493f-9593-5072557145d9+11:14409:x1876405526843136:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 6912us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480219.120419:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1789480219.128740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.128842:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843392 00000100:00100000:3.0:1789480219.128856:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843392 00000100:00100000:3.0:1789480219.128930:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1789480219.128943:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c0c9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32666111-a0c9-493f-9593-5072557145d9+11:14409:x1876405526843392:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1789480219.129253:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c0c9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32666111-a0c9-493f-9593-5072557145d9+12:14409:x1876405526843392:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 313us (528us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789480219.129262:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000040:00080000:1.0:1789480219.163041:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480219.232515:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.232905:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843520 00000100:00100000:0.0:1789480219.232918:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843520 00000100:00100000:0.0:1789480219.233001:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1789480219.233024:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+10:14415:x1876405526843520:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480219.233053:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480219.233080:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3663 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233165:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233182:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233197:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233783:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233795:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233803:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233920:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233929:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.233958:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480219.233994:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789480219.233998:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480219.234060:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234076:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234084:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234092:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234098:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480219.234103:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234112:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234124:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:0.0:1789480219.234128:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480219.234133:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234139:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037fe9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234166:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234172:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234179:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234184:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480219.234187:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234193:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234201:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2290ce3f00) 00010000:00010000:0.0:1789480219.234204:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480219.234622:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234634:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234688:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3663 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234704:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7c00/0xbb972366037fe9bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3663 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.234723:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:0.0:1789480219.234725:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789480219.234729:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7c00, rc 0) 00000100:00100000:0.0:1789480219.234832:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:14415:x1876405526843520:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1811us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480219.234841:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1789480219.246731:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.247091:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843776 00000100:00100000:2.0:1789480219.247105:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843776 00000100:00100000:2.0:1789480219.247190:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1789480219.247202:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+11:14415:x1876405526843776:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480219.247233:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480219.247259:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fe9c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f366a expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.247472:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.247489:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.247501:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.247545:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 11 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.247963:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 11 pid: 14327 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480219.247999:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552003584:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480219.248146:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2292545c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480219.252988:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552003584:192.168.204.54@tcp:104: 00010000:00010000:0.0:1789480219.253037:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480219.253066:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.253129:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526843904 00000100:00100000:0.0:1789480219.253139:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526843904 00010000:00010000:0.0:1789480219.253196:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 12 pid: 14327 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480219.253419:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1789480219.253432:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32666111-a0c9-493f-9593-5072557145d9+12:2347:x1876405526843904:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480219.253452:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480219.253461:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 12 pid: 14327 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253479:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 12 pid: 14327 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253505:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647e00/0xbb972366037fe9a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f365c expref: 12 pid: 14327 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253540:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:0.0:1789480219.253547:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253558:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253566:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.253599:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480219.253666:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32666111-a0c9-493f-9593-5072557145d9+11:2347:x1876405526843904:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 236us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480219.253675:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:2.0:1789480219.253734:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.253741:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.253768:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.253779:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.253787:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256366:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256391:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256405:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.256420:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789480219.256458:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256482:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256489:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256496:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480219.256501:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256509:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256523:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:2.0:1789480219.256526:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480219.256532:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256539:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fe9ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480219.256556:0:14327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee21685d reply state 00000000a0d02aad transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480219.256568:0:14327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789480219.256615:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fe9c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 14 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256632:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 13 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.256651:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480219.256653:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789480219.256656:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187647400, rc 0) 00000100:00100000:2.0:1789480219.256760:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+14:14415:x1876405526843776:12345-192.168.204.54@tcp:101:bash.0 Request processed in 9559us (10042us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789480219.256770:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:3.0:1789480219.258961:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.258983:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.258992:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.258999:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.259034:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.259043:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.259062:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2287eb9c00) 00010000:00010000:3.0:1789480219.259076:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.259082:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.259090:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647600/0xbb972366037fe9d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480219.272979:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.273609:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526844032 00000100:00100000:0.0:1789480219.273624:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526844032 00000100:00100000:0.0:1789480219.273701:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1789480219.273714:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+13:14415:x1876405526844032:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480219.273747:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480219.273774:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe9e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3671 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.273868:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.273886:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.273925:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480219.273980:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480219.273985:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480219.274022:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.274035:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.274077:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fe9e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3671 expref: 15 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.274101:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3671 expref: 14 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.274111:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:0.0:1789480219.274114:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480219.274119:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7a00, rc 0) 00000100:00100000:0.0:1789480219.274200:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+14:14415:x1876405526844032:12345-192.168.204.54@tcp:101:bash.0 Request processed in 489us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480219.274208:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1789480219.278686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.278833:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526844288 00000100:00100000:3.0:1789480219.278846:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526844288 00000100:00100000:3.0:1789480219.278916:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1789480219.278928:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+14:14415:x1876405526844288:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1789480219.279912:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aea98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+15:14415:x1876405526844288:12345-192.168.204.54@tcp:35:bash.0 Request processed in 982us (1236us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789480219.279922:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1789480219.338621:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.338826:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526844544 00000100:00100000:2.0:1789480219.338840:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526844544 00000100:00100000:2.0:1789480219.338938:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1789480219.338964:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+15:14425:x1876405526844544:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480219.338999:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480219.339038:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fe9f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3678 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.339695:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480219.339871:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fe9f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3678 expref: 17 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.340024:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:2.0:1789480219.340028:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480219.340036:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fe9f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3678 expref: 17 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.340056:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646e00, rc 0) 00000100:00100000:2.0:1789480219.340153:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+16:14425:x1876405526844544:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1203us (1547us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789480219.340403:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:1.0:1789480219.344647:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.344723:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526844800 00000100:00100000:2.0:1789480219.344832:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526844800 00000100:00100000:2.0:1789480219.344908:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1789480219.344922:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+16:14425:x1876405526844800:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480219.345239:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+17:14425:x1876405526844800:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 320us (656us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789480219.345248:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1789480219.381697:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.381798:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845056 00000100:00100000:3.0:1789480219.381812:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845056 00000100:00100000:3.0:1789480219.381952:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1789480219.381967:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+17:14428:x1876405526845056:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1789480219.382014:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480219.382043:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fea02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f367f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.382520:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fea09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.382540:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fea09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.382614:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fea09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.382629:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789480219.382809:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3800/0xbb972366037fea02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f367f expref: 20 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.382833:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fea09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f367f expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.382843:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480219.382846:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480219.382851:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646e00, rc 0) 00000100:00100000:2.0:1789480219.382936:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:14428:x1876405526845056:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 972us (1254us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789480219.382953:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1789480219.386849:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.387983:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.388197:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845312 00000100:00100000:3.0:1789480219.388210:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845312 00000100:00100000:3.0:1789480219.388476:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1789480219.388491:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:2345:x1876405526845312:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480219.388524:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480219.388558:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037fea09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f367f expref: 19 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.388873:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480219.388882:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480219.388958:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:2345:x1876405526845312:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 470us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.388966:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1789480219.390918:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845184 00000100:00100000:2.0:1789480219.391042:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845184 00000100:00100000:2.0:1789480219.391274:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1789480219.391305:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:14428:x1876405526845184:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1789480219.391405:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391426:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391441:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391475:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391484:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391492:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391499:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480219.391511:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391520:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391533:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480219.391553:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480219.391559:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.391567:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480219.391658:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:14428:x1876405526845184:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 373us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480219.391677:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1789480219.400042:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.400826:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845568 00000100:00100000:2.0:1789480219.400842:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845568 00000100:00100000:2.0:1789480219.401101:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1789480219.401114:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:14428:x1876405526845568:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1789480219.401721:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:14428:x1876405526845568:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 607us (1691us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789480219.401731:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1789480219.503514:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.503569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.503665:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.503697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480219.503768:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845696 00000100:00100000:0.0:1789480219.503781:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845696 00000100:00100000:0.0:1789480219.503852:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1789480219.503864:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526845696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480219.503972:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526845696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480219.504010:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:1.0:1789480219.509650:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.513491:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845824 00000100:00100000:3.0:1789480219.513514:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845824 00000100:00100000:3.0:1789480219.513632:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526846080 00000100:00100000:3.0:1789480219.513636:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526846080 00000100:00100000:3.0:1789480219.513655:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526845952 00000100:00100000:3.0:1789480219.513659:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526845952 00000100:00100000:3.0:1789480219.513684:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789480219.513696:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2345:x1876405526845824:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480219.513811:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2345:x1876405526845824:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (10312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.513819:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789480219.513860:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480219.513867:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32666111-a0c9-493f-9593-5072557145d9+5:2345:x1876405526846080:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480219.513895:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32666111-a0c9-493f-9593-5072557145d9+5:2345:x1876405526846080:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (10326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.514027:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1789480219.514041:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480219.514049:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2345:x1876405526845952:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480219.514078:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2345:x1876405526845952:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (10380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.514085:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00080000:2.0:1789480219.514604:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480219.514610:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480219.515142:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526846208 00000100:00100000:3.0:1789480219.515150:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526846208 00000100:00100000:3.0:1789480219.515426:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1789480219.515436:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32666111-a0c9-493f-9593-5072557145d9+5:2345:x1876405526846208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480219.515496:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32666111-a0c9-493f-9593-5072557145d9+5:2345:x1876405526846208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 61us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.515503:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00080000:2.0:1789480219.518040:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789480219.677096:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480219.847324:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.847559:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526846464 00000100:00100000:2.0:1789480219.847583:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526846464 00000100:00100000:2.0:1789480219.847671:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1789480219.847684:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:14459:x1876405526846464:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1789480219.847718:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480219.847744:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3686 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.847987:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037fea25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.848031:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037fea25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.848045:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037fea25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.848126:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789480219.848933:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3686 expref: 22 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.848961:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037fea25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3686 expref: 21 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.848971:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480219.848973:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480219.848979:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646c00, rc 0) 00000100:00100000:2.0:1789480219.849358:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:14459:x1876405526846464:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1675us (2084us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789480219.849367:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480219.855273:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480219.855348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.855434:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526846720 00000100:00100000:2.0:1789480219.855446:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526846720 00000100:00100000:2.0:1789480219.855519:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1789480219.855531:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:14459:x1876405526846720:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:2.0:1789480219.855988:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:14459:x1876405526846720:12345-192.168.204.54@tcp:35:cat.0 Request processed in 458us (728us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789480219.856008:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1789480219.856321:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526846848 00000100:00100000:0.0:1789480219.856327:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526846848 00000100:00100000:0.0:1789480219.856378:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1789480219.856386:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:2347:x1876405526846848:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480219.856399:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480219.856429:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037fea25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3686 expref: 22 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480219.856451:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:0.0:1789480219.856458:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480219.856482:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:2347:x1876405526846848:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 97us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480219.856489:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1789480219.961134:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480219.961330:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526847104 00000100:00100000:2.0:1789480219.961351:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526847104 00000100:00100000:2.0:1789480219.961435:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1789480219.961448:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:14465:x1876405526847104:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1789480219.961479:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480219.961505:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f368d expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.961673:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fea3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.961691:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fea3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.961706:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fea3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480219.961718:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789480219.962118:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f368d expref: 24 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.962141:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fea3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f368d expref: 23 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480219.962151:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480219.962154:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480219.962159:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187647a00, rc 0) 00000100:00100000:2.0:1789480219.962334:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:14465:x1876405526847104:12345-192.168.204.54@tcp:101:dd.0 Request processed in 889us (1214us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789480219.962344:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1789480219.976175:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480219.976373:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526847360 00000100:00100000:3.0:1789480219.976387:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526847360 00000100:00100000:3.0:1789480219.976470:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1789480219.976482:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:14465:x1876405526847360:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:3.0:1789480219.976559:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789480219.976594:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037fea3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f368d expref: 23 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.976635:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037fe9ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3671 expref: 22 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.976646:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480219.976652:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480219.977808:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.977831:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.977844:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480219.977921:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789480219.977951:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001762dc8c reply state 000000001f34a93b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480219.977962:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480219.978168:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+24:14465:x1876405526847360:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1685us (2005us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789480219.978179:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000020:00080000:3.0:1789480219.978186:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480219.981742:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981763:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981772:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981797:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d3000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480219.981803:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981885:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981908:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480219.981912:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480219.981918:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480219.981925:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037fea48 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480219.994804:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552003712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480219.994911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480219.995136:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003712 00000100:00100000:3.0:1789480219.995147:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003712 00000100:00100000:3.0:1789480219.995444:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480219.995456:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552003712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480219.995505:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789480219.995565:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876405552003712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480219.995572:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480219.995626:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876405552003712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480219.998729:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552004224:0@lo:400:kworker.0 00000100:00100000:2.0:1789480219.998751:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552003968:0@lo:400:kworker.0 00000100:00100000:1.0:1789480219.999640:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552003840:0@lo:400:kworker.0 00000100:00100000:3.0:1789480220.000038:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480220.000050:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480220.000153:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480220.000166:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552004096:0@lo:400:kworker.0 00000100:00100000:2.0:1789480220.000217:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480220.000322:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003968 00000100:00100000:2.0:1789480220.000336:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003968 00000100:00100000:3.0:1789480220.001067:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552004224 00000100:00100000:3.0:1789480220.001087:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552004224 00000100:00080000:0.0:1789480220.011414:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480220.011437:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480220.011444:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480220.019730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480220.019852:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552004352:0@lo:400:kworker.0 00000100:00100000:1.0:1789480220.019914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480220.020007:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552004096 00000100:00100000:1.0:1789480220.020021:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552004096 00000100:00100000:1.0:1789480220.020089:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552004352 00000100:00100000:1.0:1789480220.020095:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552004352 00000100:00100000:1.0:1789480220.020151:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789480220.020166:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552004096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480220.020309:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552004096:12345-0@lo:400:kworker.0 Request processed in 118us (20062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480220.020318:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789480220.020337:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480220.020343:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552004352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480220.020378:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552004352:12345-0@lo:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480220.020389:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480220.020452:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552004352:0@lo:400:kworker.0 00000100:00100000:1.0:1789480220.020619:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552004096:0@lo:400:kworker.0 00000100:00100000:0.0:1789480220.027090:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552003840 00000100:00100000:0.0:1789480220.027113:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552003840 00000100:00100000:0.0:1789480220.027234:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789480220.027254:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552003840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480220.027432:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552003840:12345-0@lo:400:kworker.0 Request processed in 185us (7717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480220.027440:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789480220.030469:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480220.030577:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aea99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552003840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480220.030744:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789480220.030765:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552004224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480220.030918:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876405552004224:12345-0@lo:400:kworker.0 Request processed in 163us (30881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480220.030926:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789480220.033177:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876405552004224:0@lo:400:kworker.0 00000100:00100000:2.0:1789480220.044750:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480220.044772:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552003968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480220.044908:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552003968:12345-0@lo:400:kworker.0 Request processed in 144us (44869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480220.044917:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789480220.046062:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552003968:0@lo:400:kworker.0 00000100:00100000:1.0:1789480220.105549:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.108918:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526847616 00000100:00100000:2.0:1789480220.108939:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526847616 00000100:00100000:3.0:1789480220.109382:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1789480220.109399:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:14465:x1876405526847616:12345-192.168.204.54@tcp:35:dd.0 00000100:00100000:3.0:1789480220.109782:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+24:14465:x1876405526847616:12345-192.168.204.54@tcp:35:dd.0 Request processed in 387us (4247us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1789480220.109796:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:0.0:1789480220.110008:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480220.342994:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.343263:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526847744 00000100:00100000:2.0:1789480220.343277:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526847744 00000100:00100000:2.0:1789480220.343376:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1789480220.343388:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+24:14479:x1876405526847744:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789480220.343432:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480220.343460:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea4f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f3694 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.343542:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.343560:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.344234:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.344276:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.344310:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.344318:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345266:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345312:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345322:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480220.345372:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789480220.345378:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480220.345443:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345457:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345466:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345473:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345495:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345501:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480220.345505:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345514:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345527:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:2.0:1789480220.345530:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480220.345536:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345543:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345559:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345774:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345781:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345786:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480220.345789:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345806:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345816:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2287eb9300) 00010000:00010000:2.0:1789480220.345818:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480220.345821:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345827:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.345876:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea4f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3694 expref: 26 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.346113:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3694 expref: 25 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.346121:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480220.346124:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480220.346127:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646a00, rc 0) 00000100:00100000:2.0:1789480220.346426:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+25:14479:x1876405526847744:12345-192.168.204.54@tcp:101:stat.0 Request processed in 3038us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480220.346440:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1789480220.442766:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.442912:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526848000 00000100:00100000:2.0:1789480220.442925:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526848000 00000100:00100000:2.0:1789480220.443020:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1789480220.443034:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+25:14485:x1876405526848000:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1789480220.443126:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480220.443163:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f3694 expref: 25 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.443187:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480220.443194:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480220.443792:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.443810:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.443823:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480220.443877:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1789480220.443903:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003bb18cc reply state 00000000a6c6ee54 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.443913:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480220.444068:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+27:14485:x1876405526848000:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1037us (1316us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789480220.444077:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000020:00080000:2.0:1789480220.444083:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480220.445998:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446017:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446026:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446033:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480220.446039:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446048:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446064:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480220.446068:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480220.446074:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.446081:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646800/0xbb972366037fea6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480220.622583:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.623091:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526848128 00000100:00100000:2.0:1789480220.623104:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526848128 00000100:00100000:2.0:1789480220.623183:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1789480220.623200:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+26:14499:x1876405526848128:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1789480220.623238:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480220.623330:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f369b expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623481:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623507:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623530:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623561:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623574:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623587:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623756:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.623770:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626503:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480220.626628:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789480220.626634:0:14327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789480220.626674:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626729:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626747:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626756:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626769:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.626781:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480220.628647:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629147:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629174:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:2.0:1789480220.629179:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480220.629186:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629197:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037fea79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629226:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629235:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629272:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629349:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647800 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480220.629356:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629366:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.629379:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2287eb9300) 00010000:00010000:2.0:1789480220.629382:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480220.631382:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.631410:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037fea80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.631520:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 28 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.631547:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 27 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.632818:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480220.632827:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480220.632833:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646400, rc 0) 00000100:00100000:2.0:1789480220.632965:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+27:14499:x1876405526848128:12345-192.168.204.54@tcp:101:stat.0 Request processed in 9764us (10409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480220.633023:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:3.0:1789480220.702540:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480220.760258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.760770:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526848384 00000100:00100000:2.0:1789480220.760784:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526848384 00000100:00100000:2.0:1789480220.760948:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1789480220.760966:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+27:14509:x1876405526848384:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1789480220.761011:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480220.761045:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36a2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480220.761186:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789480220.761443:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a2 expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.761463:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:2.0:1789480220.761468:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480220.761477:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a2 expref: 29 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.761499:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646a00, rc 0) 00000100:00100000:2.0:1789480220.761605:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+28:14509:x1876405526848384:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 645us (1363us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789480220.761616:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1789480220.769501:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480220.769892:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526848640 00000100:00100000:1.0:1789480220.769906:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526848640 00000100:00100000:1.0:1789480220.769990:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789480220.770004:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22c0c9d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+28:14509:x1876405526848640:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789480220.770376:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22c0c9d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+29:14509:x1876405526848640:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 373us (888us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789480220.770385:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1789480220.894254:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.902805:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526848896 00000100:00100000:2.0:1789480220.902827:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526848896 00000100:00100000:2.0:1789480220.902935:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1789480220.902949:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+29:14515:x1876405526848896:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1789480220.903015:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480220.903042:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea9c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36a9 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903175:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903193:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903203:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903212:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903258:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903276:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.903494:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552004480:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480220.903802:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.903813:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.903838:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552004608:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480220.903868:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d229c5d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480220.911759:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552004480:192.168.204.54@tcp:104: 00000100:00100000:2.0:1789480220.911785:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552004608:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480220.911822:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480220.913985:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480220.918862:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849024 00000100:00100000:3.0:1789480220.918885:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849024 00010000:00010000:3.0:1789480220.918955:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 31 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480220.919158:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480220.919170:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22a4b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:2347:x1876405526849024:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480220.919189:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480220.919199:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 31 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.919218:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 31 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.919259:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037fea87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f369b expref: 31 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.919346:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480220.919353:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.919363:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.919371:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480220.920130:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22a4b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:2347:x1876405526849024:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 955us (6162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480220.920141:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1789480220.920793:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.921220:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849152 00000100:00100000:2.0:1789480220.921240:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849152 00010000:00010000:2.0:1789480220.921546:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.921813:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1789480220.921827:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:2348:x1876405526849152:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480220.921845:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480220.921853:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.921871:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.921898:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647400/0xbb972366037fe9d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f366a expref: 30 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.921917:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:2.0:1789480220.921941:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.921952:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.921960:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.922032:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480220.922102:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+29:2348:x1876405526849152:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 279us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480220.922110:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:1.0:1789480220.922561:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.922571:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480220.922603:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1789480220.922810:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037fea9c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 30 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.922830:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 29 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.922838:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:1.0:1789480220.922840:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789480220.922844:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187647800, rc 0) 00000100:00100000:1.0:1789480220.922881:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+29:14515:x1876405526848896:12345-192.168.204.54@tcp:101:bash.0 Request processed in 19936us (28642us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1789480220.922900:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1789480220.928514:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.928810:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849408 00000100:00100000:2.0:1789480220.928822:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849408 00000100:00100000:2.0:1789480220.928900:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1789480220.928911:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+29:14515:x1876405526849408:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1789480220.929365:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.929393:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480220.929409:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480220.929475:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1789480220.929503:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c93c62a reply state 00000000126a1f3d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.929515:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480220.930955:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14515:x1876405526849408:12345-192.168.204.54@tcp:36:bash.0 Request processed in 2033us (2442us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789480220.930981:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000020:00080000:2.0:1789480220.930989:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480220.936423:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936450:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936460:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936467:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187647000 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480220.936473:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936483:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936506:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480220.936509:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480220.936516:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.936522:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647000/0xbb972366037feab1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480220.936735:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480220.936884:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849536 00000100:00100000:1.0:1789480220.936897:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849536 00000100:00100000:1.0:1789480220.936967:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1789480220.936991:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14515:x1876405526849536:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1789480220.937023:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480220.937057:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037feab8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36b0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.937130:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037feab8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b0 expref: 32 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.937146:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037feab8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b0 expref: 32 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.937168:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:1.0:1789480220.937171:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480220.937174:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39c000, rc 0) 00000100:00100000:1.0:1789480220.937259:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14515:x1876405526849536:12345-192.168.204.54@tcp:101:bash.0 Request processed in 271us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480220.937267:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1789480220.947442:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480220.947758:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849664 00000100:00100000:2.0:1789480220.947772:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849664 00000100:00100000:3.0:1789480220.948022:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1789480220.948045:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14515:x1876405526849664:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480220.948074:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480220.948102:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037feabf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36b7 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.948421:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.948439:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 33 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.948450:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.948494:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 33 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.948512:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 33 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480220.948529:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14326:1876405552004736:192.168.204.54@tcp:104: 00000100:00100000:3.0:1789480220.948756:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22a44ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1789480220.952815:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480220.952945:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2288ed8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14326:1876405552004736:192.168.204.54@tcp:104: 00010000:00010000:3.0:1789480220.953011:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480220.953171:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526849792 00000100:00100000:1.0:1789480220.953182:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526849792 00010000:00010000:1.0:1789480220.953501:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 34 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480220.953738:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480220.953750:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+34:2348:x1876405526849792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480220.953770:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480220.953779:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 34 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953795:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 34 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953823:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647800/0xbb972366037feaa3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36a9 expref: 34 pid: 14327 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953842:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:1.0:1789480220.953848:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953860:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953869:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.953909:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480220.953994:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+33:2348:x1876405526849792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 245us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480220.954002:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00010000:00010000:0.0:1789480220.954074:0:14326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.954082:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480220.954140:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480220.954145:0:14326:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480220.954170:0:14326:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.954224:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d3000/0xbb972366037feabf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b7 expref: 33 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.954245:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b7 expref: 32 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.954253:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:0.0:1789480220.954256:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480220.954267:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2400, rc 0) 00000100:00100000:0.0:1789480220.955876:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14515:x1876405526849664:12345-192.168.204.54@tcp:101:bash.0 Request processed in 7828us (8436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480220.955891:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1789480220.962121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480220.962314:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850048 00000100:00100000:3.0:1789480220.962329:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850048 00000100:00100000:3.0:1789480220.962411:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1789480220.962424:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14515:x1876405526850048:12345-192.168.204.54@tcp:103:bash.0 00010000:00010000:3.0:1789480220.962444:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789480220.962485:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feac6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b7 expref: 32 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.962514:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c000/0xbb972366037feab8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36b0 expref: 31 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480220.962526:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2287eb9400) 00010000:00010000:3.0:1789480220.962541:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480220.962640:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:14515:x1876405526850048:12345-192.168.204.54@tcp:103:bash.0 Request processed in 208us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480220.962649:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1789480220.965936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480220.966027:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850176 00000100:00100000:1.0:1789480220.966050:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850176 00000100:00100000:1.0:1789480220.966123:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480220.966136:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:14515:x1876405526850176:12345-192.168.204.54@tcp:58:bash.0 00010000:00010000:1.0:1789480220.966264:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.966504:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480220.966521:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480220.968883:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480220.969825:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789480220.969932:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789480220.970264:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:14515:x1876405526850176:12345-192.168.204.54@tcp:58:bash.0 Request processed in 4122us (4334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480220.970316:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1789480220.973934:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480220.974065:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850304 00000100:00100000:0.0:1789480220.974080:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850304 00000100:00100000:0.0:1789480220.974159:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1789480220.974171:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+30:14515:x1876405526850304:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1789480220.974199:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480220.974226:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36be expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974350:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974365:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 31 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974388:0:14326:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974404:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 31 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974420:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480220.974424:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480220.974427:0:14326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 31 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480220.974457:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6000, rc 0) 00000100:00100000:0.0:1789480220.974537:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14515:x1876405526850304:12345-192.168.204.54@tcp:101:bash.0 Request processed in 368us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480220.974546:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1789480221.018792:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22aeac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552004864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480221.018896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480221.023653:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552004864 00000100:00100000:3.0:1789480221.023676:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552004864 00000100:00100000:2.0:1789480221.023884:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480221.023896:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552004864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480221.023949:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789480221.024334:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552004864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 439us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.024344:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789480221.025690:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22aeac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552004864:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789480221.210632:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480221.210645:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480221.210714:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789480221.210725:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789480221.210900:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bfdce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14361:1876405552004992:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480221.211059:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480221.219641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.221766:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bfdce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14361:1876405552004992:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480221.227843:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850432 00000100:00100000:1.0:1789480221.227865:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850432 00000100:00100000:1.0:1789480221.227956:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480221.227980:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850432:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789480221.228114:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850432:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 147us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.228123:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1789480221.233945:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.235221:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850560 00000100:00100000:2.0:1789480221.235238:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850560 00000100:00100000:2.0:1789480221.235354:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789480221.235367:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480221.235424:0:14327:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480221.235622:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850560:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 257us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.235631:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1789480221.248524:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.254245:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850688 00000100:00100000:0.0:1789480221.254268:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850688 00000100:00100000:0.0:1789480221.255046:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1789480221.255060:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480221.255160:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255180:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255199:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255217:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255225:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255232:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255260:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255317:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255324:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480221.255386:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480221.255392:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789480221.255422:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255436:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255444:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255451:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255458:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.255464:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255473:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255487:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d22837b7900) 00010000:00010000:0.0:1789480221.255491:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.255497:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255515:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6600/0xbb972366037feadb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255532:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255537:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255543:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255560:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.255564:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255571:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255579:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d2290ce3f00) 00010000:00010000:0.0:1789480221.255582:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.255585:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255591:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037feae2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255606:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255612:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255625:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255630:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.255633:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255640:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255648:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.255650:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.255654:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.255660:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feae9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.255766:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850688:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 707us (8222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480221.255776:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1789480221.263265:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.263536:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526850944 00000100:00100000:0.0:1789480221.263550:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526850944 00000100:00100000:0.0:1789480221.263627:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:0.0:1789480221.263639:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+31:14517:x1876405526850944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480221.263669:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480221.263696:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feaf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36c5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.263861:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.263879:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.263892:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480221.263907:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789480221.264051:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264060:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264067:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264074:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7a00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.264080:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264088:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264103:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.264106:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480221.264112:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264129:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7a00/0xbb972366037feaf7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264177:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feaf0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36c5 expref: 33 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264188:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d22837b7900) 00010000:00010000:0.0:1789480221.264190:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480221.264194:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feaf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36c5 expref: 33 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.264204:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e7600, rc 0) 00000100:00100000:0.0:1789480221.265159:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14517:x1876405526850944:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1514us (1901us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1789480221.265170:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1789480221.269877:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.269987:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526851072 00000100:00100000:0.0:1789480221.270000:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526851072 00000100:00100000:0.0:1789480221.270127:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1789480221.270141:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14517:x1876405526851072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789480221.270189:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480221.270375:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bfdcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14517:x1876405526851072:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 236us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480221.270394:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1789480221.274158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.275357:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526851328 00000100:00100000:2.0:1789480221.275373:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526851328 00000100:00100000:2.0:1789480221.275445:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480221.275475:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+32:14517:x1876405526851328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480221.275506:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480221.275532:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037feb05 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36cc expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480221.276360:0:14327:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1789480221.276368:0:14327:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789480221.276430:0:14327:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789480221.276753:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037feb0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.276771:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037feb0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.276786:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037feb0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.276852:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646a00/0xbb972366037feb05 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36cc expref: 35 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.276872:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037feb0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36cc expref: 34 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.276881:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9300) 00010000:00010000:2.0:1789480221.276885:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480221.276889:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646400, rc 0) 00000100:00100000:2.0:1789480221.276983:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+34:14517:x1876405526851328:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1509us (2838us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789480221.276992:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1789480221.286036:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480221.286165:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526851584 00000100:00100000:3.0:1789480221.286179:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526851584 00000100:00100000:3.0:1789480221.286246:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789480221.286259:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+34:14517:x1876405526851584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480221.286365:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480221.286403:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646400/0xbb972366037feb0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36cc expref: 34 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286429:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9300) 00010000:00010000:3.0:1789480221.286444:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480221.286476:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286493:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286524:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286541:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286548:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286554:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286638:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286647:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286655:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286662:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480221.286667:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286675:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286684:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:3.0:1789480221.286687:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480221.286692:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286710:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286722:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286727:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286733:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286737:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22813d2600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:3.0:1789480221.286740:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286746:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286753:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x73a8f49f (ffff8d22837b7200) 00010000:00010000:3.0:1789480221.286756:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480221.286759:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.286765:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb21 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73a8f49f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480221.286874:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+33:14517:x1876405526851584:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 617us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789480221.286883:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1789480221.291506:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.291651:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526851712 00000100:00100000:2.0:1789480221.291664:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526851712 00000100:00100000:2.0:1789480221.291726:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789480221.291738:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+33:14517:x1876405526851712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480221.291779:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480221.291810:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037feb28 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36d3 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.291861:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037feb2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.291879:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037feb2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.291893:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037feb2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.292038:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187647a00/0xbb972366037feb28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36d3 expref: 35 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.292059:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646c00/0xbb972366037feb2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36d3 expref: 34 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.292068:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:2.0:1789480221.292071:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480221.292075:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646c00, rc 0) 00000100:00100000:2.0:1789480221.292155:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+34:14517:x1876405526851712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 419us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.292175:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1789480221.297726:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.297882:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526851968 00000100:00100000:0.0:1789480221.297896:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526851968 00000100:00100000:0.0:1789480221.297981:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1789480221.298013:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+34:14517:x1876405526851968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480221.299747:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.299771:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.299785:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480221.300229:0:14327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789480221.300241:0:14327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 514296957862ns, next at 515296955736ns, rc = 0 00000004:00010000:0.0:1789480221.300355:0:14327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff5269d reply state 0000000023b2c2f3 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.300365:0:14327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480221.300480:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+36:14517:x1876405526851968:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2467us (2766us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789480221.300491:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:1.0:1789480221.309123:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309156:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309166:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309174:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e7600 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:1.0:1789480221.309180:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309190:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309212:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:1.0:1789480221.309216:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789480221.309243:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.309250:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e7600/0xbb972366037feb36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480221.316480:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480221.318240:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852096 00000100:00100000:3.0:1789480221.318260:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852096 00000100:00100000:3.0:1789480221.318368:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789480221.318381:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+35:14517:x1876405526852096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480221.318416:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480221.318443:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36da expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.318522:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 36 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.318539:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 36 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.318930:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:3.0:1789480221.318934:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480221.318940:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2600, rc 0) 00000100:00100000:3.0:1789480221.319392:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+36:14517:x1876405526852096:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1011us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480221.319401:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1789480221.328949:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.329610:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852224 00000100:00100000:1.0:1789480221.329625:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852224 00000100:00100000:1.0:1789480221.329725:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480221.329742:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2348:x1876405526852224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789480221.330821:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480221.330859:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2348:x1876405526852224:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 1116us (1920us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789480221.330868:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1789480221.337985:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.338176:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852480 00000100:00100000:1.0:1789480221.338189:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852480 00000100:00100000:3.0:1789480221.338355:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480221.338373:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+36:14517:x1876405526852480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480221.338993:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+37:14517:x1876405526852480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 625us (1033us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789480221.339034:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1789480221.342515:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.343068:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852736 00000100:00100000:1.0:1789480221.343083:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852736 00000100:00100000:1.0:1789480221.343205:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1789480221.343219:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+37:14517:x1876405526852736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480221.343499:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+37:14517:x1876405526852736:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 282us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.343508:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:2.0:1789480221.346993:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480221.347101:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852864 00000100:00100000:3.0:1789480221.347114:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852864 00000100:00100000:3.0:1789480221.347187:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1789480221.347200:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+37:14517:x1876405526852864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480221.347227:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480221.347374:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36e1 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347527:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347613:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347630:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480221.347679:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789480221.347704:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347741:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2400/0xbb972366037feb44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e1 expref: 39 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347763:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e1 expref: 38 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.347796:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:3.0:1789480221.347800:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480221.347805:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2e00, rc 0) 00000100:00100000:3.0:1789480221.347881:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+38:14517:x1876405526852864:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 684us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480221.347888:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1789480221.352352:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.352565:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526852992 00000100:00100000:2.0:1789480221.352580:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526852992 00000100:00100000:2.0:1789480221.352655:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1789480221.352668:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bab45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526852992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480221.352693:0:15012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480221.352721:0:15012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36e8 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480221.352756:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94d1d, blocks: 0x1 00010000:00010000:2.0:1789480221.352788:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=514s v=(0 0) 00010000:00010000:2.0:1789480221.352794:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480221.352805:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 7 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.352829:0:15012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 7 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.352845:0:15012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2187646a00, rc 0) 00000100:00100000:2.0:1789480221.353024:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bab45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:2347:x1876405526852992:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 357us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.353033:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789480221.355756:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.356126:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526853248 00000100:00100000:0.0:1789480221.356209:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526853248 00000100:00100000:0.0:1789480221.356312:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1789480221.356325:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+38:14517:x1876405526853248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789480221.356721:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+38:14517:x1876405526853248:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 398us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480221.356730:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1789480221.360111:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.360250:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526853376 00000100:00100000:0.0:1789480221.360262:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526853376 00000100:00100000:0.0:1789480221.360366:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1789480221.360391:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+38:14517:x1876405526853376:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789480221.446176:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+38:14517:x1876405526853376:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 85785us (86065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.446194:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000001:00080000:0.0:1789480221.446620:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1789480221.446628:0:5852:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789480221.446653:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1789480221.446672:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1789480221.446719:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1789480221.446735:0:5852:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789480221.447635:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480221.447660:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552005120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789480221.447846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480221.448041:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552005120 00000100:00100000:3.0:1789480221.448052:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552005120 00000100:00100000:3.0:1789480221.448120:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789480221.448133:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552005120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789480221.448381:0:15010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789480221.448386:0:15010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789480221.448388:0:15010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789480221.448390:0:15010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789480221 -> 1789480221 00002000:00010000:3.0:1789480221.448393:0:15010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789480221.448462:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876405552005120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 332us (619us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789480221.448469:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789480221.448951:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d22bab47100/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789480221.448973:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bab47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552005120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789480221.456568:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.457953:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526853504 00000100:00100000:0.0:1789480221.457983:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526853504 00000100:00100000:2.0:1789480221.458146:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1789480221.458161:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:2348:x1876405526853504:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789480221.458342:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d218706bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:2348:x1876405526853504:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 184us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.458352:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480221.463215:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.463438:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526853760 00000100:00100000:0.0:1789480221.463452:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526853760 00000100:00100000:2.0:1789480221.463696:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1789480221.463709:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+13:14517:x1876405526853760:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480221.464601:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480221.464748:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2e00/0xbb972366037feb4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e1 expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.464775:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:2.0:1789480221.464781:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480221.464850:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.464868:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.464879:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480221.465849:0:14326:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009978cedb reply state 000000000692e1c8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480221.465862:0:14326:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480221.466012:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+14:14517:x1876405526853760:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2302us (2809us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789480221.466037:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1789480221.473940:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1789480221.474235:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474252:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474262:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474269:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2187646e00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:2.0:1789480221.474274:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474328:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474351:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:2.0:1789480221.474355:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480221.474361:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.474368:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2187646e00/0xbb972366037feb59 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.474660:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526853888 00000100:00100000:0.0:1789480221.474673:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526853888 00000100:00100000:0.0:1789480221.474741:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1789480221.474754:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:14517:x1876405526853888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480221.474776:0:15010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480221.474797:0:15010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36ef expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.474835:0:15010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.474846:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480221.474852:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480221.474857:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.474917:0:15010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.474938:0:15010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.474955:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15010:1876405552005248:192.168.204.54@tcp:104: 00000100:00100000:0.0:1789480221.475136:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291764c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.480759:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15010:1876405552005248:192.168.204.54@tcp:104: 00010000:00010000:2.0:1789480221.480810:0:15010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.480867:0:15010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb0e6c00, rc 0) 00000100:00100000:2.0:1789480221.480935:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:14517:x1876405526853888:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6182us (7012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.480945:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1789480221.481656:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.482239:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854016 00000100:00100000:1.0:1789480221.482251:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854016 00010000:00010000:1.0:1789480221.482348:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.482388:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1789480221.482398:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:2348:x1876405526854016:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480221.482422:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480221.482454:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.482473:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.482504:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004faca5d7/0xbb972366037feb52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36e8 expref: 8 pid: 15012 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.482523:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480221.482529:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480221.482537:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 7 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.483038:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 7 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.483094:0:14311:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 7 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.483113:0:14311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14311:1876405552005376:192.168.204.54@tcp:105: 00000100:00100000:1.0:1789480221.483221:0:14311:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.486407:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480221.486537:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854144 00000100:00100000:3.0:1789480221.486607:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854144 00000100:00100000:3.0:1789480221.486718:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1789480221.486747:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:2347:x1876405526854144:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789480221.486952:0:14311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14311:1876405552005376:192.168.204.54@tcp:105: 00010000:00010000:1.0:1789480221.486998:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1789480221.487091:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789480221.487096:0:15012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789480221 00002000:00010000:3.0:1789480221.487099:0:15012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789480219 00002000:00010000:3.0:1789480221.487102:0:15012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789480221 -> 1789480221 00002000:00010000:3.0:1789480221.487105:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789480221.487118:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:2348:x1876405526854016:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 4720us (5466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.487131:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1789480221.487139:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:2347:x1876405526854144:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 395us (744us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789480221.487149:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1789480221.490349:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.490474:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854272 00000100:00100000:1.0:1789480221.490487:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854272 00000100:00100000:1.0:1789480221.490624:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1789480221.490641:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:2346:x1876405526854272:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789480221.490702:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.490740:0:15011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.490751:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480221.490773:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480221.490779:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.490826:0:15011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 8 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.490847:0:15011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 8 pid: 15010 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.490866:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15011:1876405552005504:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480221.490985:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789480221.504242:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.504384:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15011:1876405552005504:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480221.504419:0:15011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480221.504944:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854400 00000100:00100000:3.0:1789480221.504954:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854400 00010000:00010000:3.0:1789480221.505018:0:14312:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 9 pid: 15010 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480221.505068:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1789480221.505079:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+9:2348:x1876405526854400:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480221.505100:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480221.505129:0:14312:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 9 pid: 15010 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.505147:0:14312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 9 pid: 15010 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.505179:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d108b150/0xbb972366037feb60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36ef expref: 9 pid: 15010 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.505241:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480221.505246:0:14312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480221.505254:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.505266:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.505343:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480221.506038:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:2348:x1876405526854400:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 957us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480221.506049:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1789480221.507095:0:15011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507113:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507153:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507164:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507189:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507197:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:1.0:1789480221.507202:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507212:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507233:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.507241:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832bc8a6/0xbb972366037feb67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.507370:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:2346:x1876405526854272:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 16730us (17033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.507380:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1789480221.512112:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.512233:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854656 00000100:00100000:1.0:1789480221.512246:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854656 00000100:00100000:1.0:1789480221.512347:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1789480221.512359:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+13:14517:x1876405526854656:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789480221.512465:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.512502:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.512867:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.513354:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.513369:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 14 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.513379:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.513421:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 14 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.513438:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 14 pid: 14328 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.513454:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552005632:192.168.204.54@tcp:104: 00000100:00100000:1.0:1789480221.513939:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bb29c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.517795:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.517993:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552005632:192.168.204.54@tcp:104: 00010000:00010000:1.0:1789480221.518032:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480221.518115:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854784 00000100:00100000:3.0:1789480221.518125:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854784 00010000:00010000:3.0:1789480221.518172:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 15 pid: 14328 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480221.518217:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1789480221.518228:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+15:2347:x1876405526854784:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480221.518245:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480221.518253:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 15 pid: 14328 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.518269:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 15 pid: 14328 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.518684:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22813d2600/0xbb972366037feb3d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36da expref: 15 pid: 14328 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.518702:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:3.0:1789480221.519006:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.519079:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.519089:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480221.519239:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480221.519346:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+14:2347:x1876405526854784:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1117us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.519358:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:1.0:1789480221.520839:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.520869:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480221.521199:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1789480221.521655:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1789480221.521703:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1789480221.521802:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1876405552005760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789480221.522040:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480221.522185:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22aea6a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.529944:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552005760 00000100:00100000:2.0:1789480221.529979:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552005760 00000100:00100000:2.0:1789480221.530050:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480221.530063:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1876405552005760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789480221.530727:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1876405552005760:12345-0@lo:1000:mdt00_001.0 Request processed in 666us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480221.530747:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480221.530916:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1876405552005760:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789480221.532459:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1789480221.532835:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1876405552005888:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789480221.534170:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480221.534405:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d22bd6db780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.546419:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552005888 00000100:00100000:2.0:1789480221.546433:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552005888 00000100:00100000:2.0:1789480221.546509:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480221.546521:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1876405552005888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789480221.547199:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14327:x1876405552005888:12345-0@lo:1000:mdt00_001.0 Request processed in 679us (13032us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789480221.547209:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480221.549599:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22ba439c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14327:1876405552005888:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789480221.549650:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549661:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549669:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549675:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39cc00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.549680:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549688:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549718:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:0.0:1789480221.549721:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480221.549736:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549743:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39cc00/0xbb972366037feb75 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549780:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549787:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549792:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549797:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39d400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.549800:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549805:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549813:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.549815:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480221.549823:0:14327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549833:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549850:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.549915:0:14327:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6000/0xbb972366037fead4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36be expref: 17 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.549930:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552006016:192.168.204.54@tcp:105: 00000100:00100000:0.0:1789480221.550042:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2291764c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480221.560870:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.561004:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526854912 00000100:00100000:1.0:1789480221.561027:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526854912 00000100:00100000:0.0:1789480221.561035:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d22bb39ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14327:1876405552006016:192.168.204.54@tcp:105: 00010000:00010000:0.0:1789480221.561077:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561100:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d400/0xbb972366037feacd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.561111:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1789480221.561134:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:14515:x1876405526854912:12345-192.168.204.54@tcp:49:bash.0 00010000:00010000:0.0:1789480221.561161:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561180:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561194:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561220:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561228:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561257:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561263:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.561268:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561277:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480221.561335:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+18:14515:x1876405526854912:12345-192.168.204.54@tcp:49:bash.0 Request processed in 208us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480221.561347:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:0.0:1789480221.561364:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.561370:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.561375:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561382:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb7c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561395:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561401:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561407:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561412:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39c400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.561415:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561433:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561442:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.561445:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480221.561448:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.561453:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39c400/0xbb972366037feb6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.561753:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+17:14517:x1876405526854656:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 49394us (49652us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789480221.561766:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000020:00080000:0.0:1789480221.561773:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789480221.562190:0:14361:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480221.562197:0:14361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480221.562229:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789480221.562234:0:14361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789480221.568231:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480221.568836:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480221.568942:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526855296 00000100:00100000:3.0:1789480221.568952:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526855296 00000100:00100000:3.0:1789480221.569157:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1789480221.569169:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+7:14515:x1876405526855296:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1789480221.569188:0:15738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480221.569209:0:15738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c9aee52/0xbb972366037feb83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36f6 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480221.569236:0:15738:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa94d1d, atime: 0x6aa94d1b, ctime: 0x6aa94d1d, blocks: 0x1 00010000:00010000:3.0:1789480221.569257:0:15738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1789480221.569262:0:15738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480221.569272:0:15738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c9aee52/0xbb972366037feb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36f6 expref: 8 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.569332:0:15738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c9aee52/0xbb972366037feb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36f6 expref: 8 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.569344:0:15738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22813d2600, rc 0) 00000100:00100000:1.0:1789480221.569488:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526855168 00000100:00100000:1.0:1789480221.569576:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526855168 00000100:00100000:1.0:1789480221.569627:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1789480221.569636:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+17:14517:x1876405526855168:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480221.570329:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:14515:x1876405526855296:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1160us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480221.570337:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000004:00080000:1.0:1789480221.574439:0:14329:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789480221.574560:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1789480221.574622:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574639:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574651:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574659:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574666:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574672:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.574703:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789480221.574824:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:14517:x1876405526855168:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 5185us (6598us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1789480221.574834:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000020:00080000:1.0:1789480221.574841:0:14329:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789480221.576329:0:14315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480221.576341:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.576351:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb39ce00 already unused, calling callback (ffffffffc14f88b0) 00010000:00010000:3.0:1789480221.576356:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.576377:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.576394:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2287eb9500) 00010000:00010000:3.0:1789480221.576397:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480221.576403:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.576409:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39ce00/0xbb972366037feb8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480221.576425:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480221.576427:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480221.576439:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480221.576653:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.576806:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526855552 00000100:00100000:0.0:1789480221.576822:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526855552 00000100:00100000:0.0:1789480221.576899:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1789480221.576912:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+19:14515:x1876405526855552:12345-192.168.204.54@tcp:35:bash.0 00000001:00080000:0.0:1789480221.580891:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1789480221.581128:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:14515:x1876405526855552:12345-192.168.204.54@tcp:35:bash.0 Request processed in 4210us (4469us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1789480221.581141:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000020:00080000:0.0:1789480221.581148:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789480221.682833:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.685318:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526855808 00000100:00100000:1.0:1789480221.685333:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526855808 00000100:00100000:1.0:1789480221.685430:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1789480221.685440:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22aeac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+21:14527:x1876405526855808:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1789480221.685478:0:14326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480221.685509:0:14326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037feb91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4a0812db605f36fd expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480221.685598:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789480221.685712:0:14326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037feb91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36fd expref: 23 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.685726:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d22837b7300) 00010000:00010000:1.0:1789480221.685743:0:14326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480221.685749:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb39d000/0xbb972366037feb91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0x4a0812db605f36fd expref: 23 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480221.685763:0:14326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d22bb39d000, rc 0) 00000100:00100000:1.0:1789480221.685832:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22aeac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:14527:x1876405526855808:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 394us (3008us total) trans 8589934633 rc 301/301 00000100:00100000:1.0:1789480221.685840:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1789480221.690151:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480221.690267:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526855936 00000100:00100000:0.0:1789480221.690325:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526855936 00000100:00100000:0.0:1789480221.690402:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1789480221.690414:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:14527:x1876405526855936:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1789480221.690527:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690557:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690572:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690588:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690596:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690603:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690871:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690881:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690888:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480221.690936:0:14327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690950:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690979:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690987:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.690994:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6200 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.691000:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691008:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691023:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2287eb9a00) 00010000:00010000:0.0:1789480221.691026:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.691032:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691039:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6200/0xbb972366037feb9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691053:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691060:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691067:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691071:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6c00 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.691078:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691085:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691092:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2290ce3f00) 00010000:00010000:0.0:1789480221.691095:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.691098:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691104:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6c00/0xbb972366037feba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691118:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691125:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691131:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691136:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d22bb0e6400 already unused, calling callback (ffffffffc1f204f0) 00010000:00010000:0.0:1789480221.691139:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691145:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691151:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d228868f800) 00010000:00010000:0.0:1789480221.691154:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480221.691161:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480221.691167:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d22bb0e6400/0xbb972366037febad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480221.691245:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:14527:x1876405526855936:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 832us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480221.691253:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1789480221.695326:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480221.695449:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856192 00000100:00100000:1.0:1789480221.695464:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856192 00000100:00100000:1.0:1789480221.695538:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1789480221.695551:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+22:14527:x1876405526856192:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1789480221.695808:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:14527:x1876405526856192:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 260us (496us total) trans 8589934634 rc 0/0 00000100:00100000:1.0:1789480221.695817:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:3.0:1789480221.723592:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480222.747446:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789480223.186895:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:2.0:1789480223.186917:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1789480223.186923:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:02000400:0.0:1789480223.570745:0:16599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789480223.771222:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480224.634217:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480224.634274:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480224.634350:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480224.635440:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856448 00000100:00100000:1.0:1789480224.635465:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856448 00000100:00100000:1.0:1789480224.635541:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1789480224.635552:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:2345:x1876405526856448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1789480224.635631:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+23:2345:x1876405526856448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 81us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480224.635655:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:2.0:1789480224.635921:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480224.637018:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856576 00000100:00100000:3.0:1789480224.637028:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856576 00000100:00100000:3.0:1789480224.637102:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789480224.637113:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526856576:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480224.637172:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bd787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2345:x1876405526856576:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 62us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480224.637179:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1789480224.637240:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1789480224.637329:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856704 00000100:00100000:1.0:1789480224.637335:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856704 00000100:00100000:1.0:1789480224.637384:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1789480224.637400:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+5:2344:x1876405526856704:12345-192.168.204.54@tcp:9:kworker.0 00000100:00100000:0.0:1789480224.637537:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856320 00000100:00100000:0.0:1789480224.637543:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856320 00000100:00100000:0.0:1789480224.637573:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1789480224.637580:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526856320:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1789480224.637617:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e88bdc8-7812-42b9-968b-c1d53a5bbc1d+13:2345:x1876405526856320:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 37us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480224.637622:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00080000:0.0:1789480224.637695:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480224.637699:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789480224.638568:0:15011:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe842 00000100:00080000:1.0:1789480224.638589:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8d218785b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480224.638818:0:15011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1789480224.639885:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+2:2344:x1876405526856704:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2478us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480224.639907:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00010000:00010000:3.0:1789480224.641528:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480224.643687:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480224.643732:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480224.643769:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1789480224.643847:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856960 00000100:00100000:2.0:1789480224.643856:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856960 00000100:00100000:2.0:1789480224.643946:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857088 00000100:00100000:2.0:1789480224.643950:0:15012:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857088 00000100:00100000:2.0:1789480224.643998:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1789480224.644009:0:15012:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2282e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+5:2344:x1876405526856960:12345-192.168.204.54@tcp:9:kworker.0 00000100:00100000:1.0:1789480224.644014:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1789480224.644026:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32666111-a0c9-493f-9593-5072557145d9+5:2344:x1876405526857088:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:2.0:1789480224.644041:0:15012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe873 00000020:00000080:1.0:1789480224.644049:0:15010:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbb972366037fe87a 00000100:00080000:1.0:1789480224.644058:0:15010:0:(import.c:65:import_set_state_nolock()) ffff8d22bb0dc000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789480224.644071:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8d2187013800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480224.644095:0:15010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000001:00000004:2.0:1789480224.644103:0:15012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:1.0:1789480224.644339:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32666111-a0c9-493f-9593-5072557145d9+2:2344:x1876405526857088:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 315us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480224.644346:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1789480224.644800:0:15012:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2282e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32666111-a0c9-493f-9593-5072557145d9+2:2344:x1876405526856960:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 793us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480224.644809:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00080000:0.0:1789480224.645080:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480224.645085:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480224.645268:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526856832 00000100:00100000:3.0:1789480224.645274:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526856832 00000100:00100000:3.0:1789480224.645362:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1789480224.645369:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526856832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1789480224.645411:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32666111-a0c9-493f-9593-5072557145d9+6:2347:x1876405526856832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 42us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480224.645418:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:3.0:1789480224.645437:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480224.645443:0:14314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480224.645587:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480224.795937:0:14315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480225.114750:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480225.114773:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552006144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480225.114839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.114913:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006144 00000100:00100000:3.0:1789480225.114921:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006144 00000100:00100000:3.0:1789480225.114976:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480225.114996:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552006144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480225.115036:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789480225.115145:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480225.115269:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876405552006144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.115277:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789480225.115515:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876405552006144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480225.115654:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552006400:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.115684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.115712:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480225.115718:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552006528:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.115742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.115772:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006400 00000100:00100000:3.0:1789480225.115776:0:15010:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006400 00000100:00100000:3.0:1789480225.115812:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480225.115819:0:15010:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.115856:0:15010:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876405552006400:12345-0@lo:400:kworker.0 Request processed in 38us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.115863:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480225.115880:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006528 00000100:00100000:3.0:1789480225.115883:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006528 00000100:00100000:3.0:1789480225.115924:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789480225.115931:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552006528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.115961:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876405552006528:12345-0@lo:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.115967:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789480225.115986:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480225.116004:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876405552006528:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.116023:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789480225.116028:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d22bab47100, transno 8589934595 00000100:00100000:0.0:1789480225.116138:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552006272:0@lo:400:kworker.0 00000100:00100000:0.0:1789480225.116170:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480225.116203:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552006784:0@lo:400:kworker.0 00000100:00100000:0.0:1789480225.116226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480225.116242:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480225.116248:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552006656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480225.116267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480225.116318:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006272 00000100:00100000:0.0:1789480225.116322:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006272 00000100:00100000:0.0:1789480225.116362:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789480225.116369:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2288c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552006272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480225.116401:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2288c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3+19:3301:x1876405552006272:12345-0@lo:400:kworker.0 Request processed in 33us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.116407:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789480225.116440:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b5f95250-f7d2-4ba1-b4cc-fdbb1697b9a3:3301:1876405552006272:0@lo:400:kworker.0 00000004:00080000:3.0:1789480225.116627:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789480225.116649:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876405552006400:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.116985:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006784 00000100:00100000:3.0:1789480225.116990:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006784 00000100:00100000:3.0:1789480225.117020:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405552006656 00000100:00100000:3.0:1789480225.117023:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405552006656 00000100:00100000:3.0:1789480225.117037:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789480225.117194:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552006784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.117237:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876405552006784:12345-0@lo:400:kworker.0 Request processed in 46us (1011us total) trans 0 rc 0/0 00000100:00080000:0.0:1789480225.117278:0:14322:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480225.117316:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876405552006784:0@lo:400:kworker.0 00000100:00100000:1.0:1789480225.117568:0:14326:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789480225.117578:0:14326:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789480225.121518:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789480225.121544:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552006656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480225.121716:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876405552006656:12345-0@lo:400:kworker.0 Request processed in 185us (5447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.121725:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789480225.122007:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789480225.127721:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2187732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876405552006656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480225.136222:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1789480225.136326:0:15738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857344 00000100:00100000:3.0:1789480225.136337:0:15738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857344 00000100:00100000:3.0:1789480225.136395:0:15738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480225.136405:0:15738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526857344:12345-192.168.204.54@tcp:16:kworker.0 00000100:00100000:3.0:1789480225.136547:0:15738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d22bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526857344:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 142us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.136555:0:15738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1789480225.137664:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1789480225.137871:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405526857216 00000100:00100000:0.0:1789480225.137879:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405526857216 00002000:00100000:0.0:1789480225.137932:0:15016:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d2187733b80 x1876405526857216/t0(0) o4->11a5fd0e-73e8-4c23-8b68-dd708fa09a05@192.168.204.54@tcp:376/0 lens 504/0 e 0 to 0 dl 1789480236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789480225.137944:0:15016:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2187733b80 with x1876405526857216 ext(0->8) 00002000:00010000:0.0:1789480225.137950:0:15016:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2187733b80 00000100:00100000:0.0:1789480225.137981:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1789480225.137989:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+6:2347:x1876405526857216:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:0.0:1789480225.138537:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2187733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11a5fd0e-73e8-4c23-8b68-dd708fa09a05+8:2347:x1876405526857216:12345-192.168.204.54@tcp:4:bash.0 Request processed in 546us (873us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789480225.138546:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1789480225.138553:0:15016:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d2187733b80 x1876405526857216/t8589934598(0) o4->11a5fd0e-73e8-4c23-8b68-dd708fa09a05@192.168.204.54@tcp:376/0 lens 504/448 e 0 to 0 dl 1789480236 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789480225.138562:0:15016:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2187733b80 with x1876405526857216 ext(0->8) 00002000:00010000:0.0:1789480225.138566:0:15016:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2187733b80 Debug log: 30357 lines, 30357 kept, 0 dropped, 0 bad.